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ABSTRACT 



Yamabico - 11 is an autonomous mobile robot used as a research platform with one 
area in image understanding. Previous work focused on edge detection analysis on a Silicon 
Graphics Iris (SGI) workstation with no method for implementation on the robot. 
Yamabico - 11 does not have an on-board image processing capability to detect straight 
edges in a grayscale image and a method for allowing the user to analyze the data. 

The approach taken for system development is partly based on edge extraction and 
line fitting algorithms of [PET92] with a 3-D geometric model of the robot’s world 
[STE92]. Image grabbing routines of [KIS95] were used to capture images with the robot’s 
digital output camera and processed using image understanding routines developed for a 
SGI workstation. The routines were modified and ported onto the robot. 

The new method of edge extraction produces less ambient noise and more 
continuous vertical line segments in the gradient image which enhances pattern matching 
analysis of the image. Yamabico- 11 ’s computer system can capture an image with a 
resolution of 739 x 484 active picture elements. Edge detection analysis is performed on 
the robot which generates a list structure of edges and stored in the robot’s memory for user 



analysis. 
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I. INTRODUCTION 



A. BACKGROUND 

Image understanding developments in the field of computer vision has provided 
advanced research capabilities for image processing applications in medicine, cartography, 
industry, manufacturing, printing and publishing, and numerous scientific fields. In all 
cases image processing is concerned with the computer processing of pictures or images 
that have been converted to a numeric form. The ability to process images in this format is 
the fundamental study and framework for image understanding of a vision system for an 
autonomous mobile robot. 

The study of robot vision has been of significant research at the Naval Postgraduate 
School in the last five years. While many of the basic approaches have undergone 
progressive refinement, numerous new directions continue to be pursued in both general 
and system specific applications. A vision system for an autonomous vehicle may be 
employed for a variety of uses including navigation, object recognition, and environmental 
mapping [DEC93]. 

In previous image understanding research, techniques were developed to 
implement a working vision based navigation control mechanism [PET92], to provide a 
capability for object recognition [DEC93], and integration of self contained image 
understanding subsystem independent of a unix workstation [KIS95]. 

B. OVERVIEW 

Yamabico- 1 1 , is an autonomous mobile robot used as a test platform for research in 
motion planning, obstacle avoidance, environment exploration, path tracking, and image 
understanding. The ability to process images instantaneously or in real-time is crucial for 
navigating in a dynamic world. The ultimate goal of the image processing system in 
Yamabico - 1 1 must be able to assess the environment and navigate with a safe and smooth 
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motion. This research develops an edge region finding algorithm and implements this 
system into the board of the YamabicoA 1. 

C. PROBLEM STATEMENT 

The major problems addressed in this research is how to develop and implement an 
image understanding system previously written for a Silicon Graphics Iris (SGI) 
workstation in an autonomous mobile robot. The resulting image understanding system 
should be a part of the total intelligent autonomous robot and should provide functionality 
that will allow the robot to process images on board in real-time. 
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II. YAMABICO-11 ROBOT 



Yamabico - 11 shown in Figure 1, is an autonomous mobile robot used as a test 
platform for research in motion planning, obstacle avoidance, environment exploration, 
path tracking, and image understanding. 




Figure 1 . Yamabico - 1 1 Autonomous Mobile Robot. 

A. HARDWARE DESCRIPTION 

Yamabico - 1 1 is powered by two 12- volt wheelchair type batteries and is driven on 
two wheels by DC motors which drive and steer the robot while four spring-loaded caster 
wheels provide balance. 
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The master processor is an Ironic’s SPARC-4 processor equivalent to a CPU Sun- 
3 workstation. This processor has 16 megabytes of main memory and runs with a clock 
speed of 33MHz on a VME bus. 

All programs on the robot are developed using a Sun 3/60 workstation and UNIX 
operating system. These programs are first compiled and then downloaded to the robot via 
a RS-232 link at 9600 baud rate using a PowerBook™ 145 computer for the communication 
interface. 

Twelve 40 kHz ultrasonic sensors are provided as the primary means by which the 
robot senses its environment. The sonar subsystem is controlled by an 8748 micro- 
controller. Each sonar reading cycle takes approximately 24 milliseconds. 

The visual images from the robot are generated by a COHU solid state camera. The 
camera is mounted along the center line of the robot at a height of 34 inches. This camera 
provide black and white video to a display monitor and to the IMS board for processing and 
further display on the NEC multisync monitor shown in Figure 2. 

The JVC TK870U CCD camera equipped with a FUJINON TV ze^m lens provides 
a NTSC standard RGB video image through a video fram.., attached to a Silicon Graphics 
Iris™ (SGI) workstation shown in Figure 2. This video image is used to process images on 
the SGI only. The framer digitizes the sync and composite signals for storage on the SGI 
and also passes the signal to a high definition monitor. The video signal is transmitted via 
standard coaxial video cable to the image processing hardware. 

The Cohu41 10 from Cohu Inc. [COH90] is a digital output camera with a 1/2 inch 
format Charge Couple Device (CCD) image sensor. The area is 6.4 mm x 4.8 mm and 739 
x 484 picture elements. The camera transfers in parallel one eight bit pixel which represents 
256 shades of gray. The digital output eliminates the need for special hardware to convert 
the cameras analog signal into digital. This design also isolates sensitive analog circuits 
away from the host computer by putting them into the camera itself. 
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Figure 2. Vision system hardware components. 



B. SOFTWARE DESCRIPTION 

The software system consists of a kernel and a user program. The kernel is 
approximately 82,000 bytes and only needs to be downloaded once during the course of a 
given experiment. The user’s program can be modified and downloaded quickly to support 
rapid development. 

Motion and sonar commands are issued by the user in MML, the model-based 
mobile robot language. While the previous version of MML was based on point-to-point 
tracking, the current version being integrated into Yamabico ' s control structure relies on a 
‘path tracking’ approach. While MML provides the capability to define path types which 
include parabolic and cubic spiral, the most fundamental ‘path’ for the robot to follow is a 
line which is defined by a curvature (k) and a location and orientation in two-dimensional 
space described in x, y, and theta. With k=0, the line is straight, and k?K) produces a circle 
of radius 1/k (k<0 = clockwise & K>0 = counter-clockwise). The location and orientation 
can be the starting point of a semi-infinite line called a forward line (/line), the end point of 
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a semi-infinite line called a backward line ( bline ), or a point and direction along an infinite 
line (line). For all path types, once one has been specified and commanded, the robot 
performs the required calculations and adjusts the curvature of its motion as necessary. 
Additionally, transitions between successive paths are performed automatically and 
autonomously. 

The functionality inherent in the MML plays a significant role in developing the 
capability for the robot to avoid obstacles. Consequently, a portion of this research effort 
was devoted to implementing some of the core functions in the newly developed ‘path 
tracking’ approach to motion control. This method allows for dynamic real-time 
specification of the proposed robot path based on sensory input and is especially well suited 
to employing the information generated from object recognition. Since the available 
information will include not only ranges (which is the sole data provided by sonar) but also 
dimensions, a complete avoidance maneuver can be determined. 

As mentioned above, the sonar system is also controlled through the MML. Both 
raw sonar range returns as well as processed ‘global’ results incorporating least-squares 
line fitting are available to the user on board the robot. This capability should prove 
particularly useful in extending the environment in which the vision system can be applied, 
and its application is addressed in the discussion of the environmental model. 
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III. IMAGE DESCRIPTION 



An image is a picture, photograph, display, or other form of visual representation 
of an object or scene. However, in digital image processing, it has another meaning: an 
image is a two dimensional array of numbers [NIB86], 

A. MATRIX STRUCTURE 

Since a digital image is similar to a matrix or array of numbers, the image can be 
represented by a structure called a bound matrix [DOU87]. The array type structure used 
to describe the images for segment extraction is shown in Figure 3 where: 

- P ( b j) indicates the light intensity of the picture element and is a 
non-negative value. 

- P (0, 0) is considered to be the origin. 
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Figure 3. Bound matrix representation of image. 

The numbers used for the light intensity of the pixel gives its level of darkness or 
lightness of the pixel area. Since each pixel is stored as a byte, 8 bits, the maximum pixel 
value is 255. This topic of pixel storage will be discussed in the next section on RGB 
Format. A higher number represents a lighter area with the maximum value 255 being 
white and 0 being black. All intermediate values will be shades of grey. 
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A 12 by 12 matrix shown in Figure 4 was used to represent an example image with 
different levels of light intensities. The array of numbers represented in the matrices were 
used to evaluate edge region generation and linear feature extraction discussed in the next 
section. The source code and results can be seen in Appendix A. 
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Figure 4. 12x12 matrix of pixel intensities of a square image. 



B. RGB FORMAT AND GRAYSCALE CONVERSION 

A single pixel is described in a RGB format which is comprised of 32 bits. The basic 
color components of each pixel in the image are red, green, and blue and are each 
represented by a byte, 8 bits. This gives an intensity value a range of 0 to 255 for each 
component. The alpha component, which represents the transparency of the pixel, is not 
considered when using the RGB format since all pixels are taken to be completely opaque. 
As was discussed earlier, an intensity value of zero represents a black pixel and an intensity 
value of 255 represents a white pixel. Figure 5 shows the bit placement for the RGB format. 
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Figure 5. The RGB Format. 



The data for all the pixels in an image is stored in a long, one-dimensional array. 
The ordering in the array with regard to position in the image is left to right, bottom to top 
so the lower left comer pixel would be the first element in the array while the upper right 
would be the last. Since the edge extraction process requires a black and white (‘grayscale’) 
representation for the pixels in an image, a conversion from the RGB values is necessary. 
According to the standard weighting factors set by the National Television Systems 
Committee (NTSC), a RGB color pixel is given an equivalent grayscale value by the 
following equation: 



GRAYSCALE = [0.299 0.587 0.114] 



Red Intensity 
Green Intensity 
Blue Intensity 



(Eq 1) 



C. GRADIENT IMAGE 

The previous example of the matrix image in Figure 4 of different light intensities 
were simplified in order to evaluate the region finding and linear fitting algorithms. Using 
an array of numbers in the matrix, we could represent different light intensities called 
grayscale values. The gradient image would simulate contrasting regions between the areas 
of similar light intensities within the image. This simplification allowed for the evaluation 
of the region finding and line extraction algorithms prior to testing them in a real and more 
complex image such as Figure 6. Figure 7 shows the gradient image as a result of applying 
the edge extraction algorithm to the input image in Figure 6. 
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Figure 6. Grayscale image of hallway with chair. 




Figure 7. Gradient image of hallway with chair. 
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IV. EDGE EXTRACTION 



A. GRADIENT-TYPE EDGE DETECTORS 

The gradient-type edge detectors are used to determine pixel gradients. Two partial 
difference operators, one for determining the change of pixel intensities in the horizontal 
( dx ) direction and another for the vertical direction, must be specified. Gradient-type edge 
detectors are square matrices of weights, mapped onto a group about a central pixel or 
point. The weights are multiplied with the intensities of the eight surrounding pixels and 
then summed to provide values for the intensity changes in the horizontal and vertical axes. 
Commonly used gradient-type edge detectors are Prewitt, Sobel, and Roberts gradients 
[BAL82] shown in Figures 7 through 10. 
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Figure 8. Prewitt gradient edge detectors. 
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Figure 9. Sobel gradient edge detectors. 
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Figure 10. Roberts gradient edge detectors. 



A modified Sobel gradient edge detector with values of Jl vice 2 for weights of 

the non-diagonal pixels in Figure 10 is used to compensate for a two-dimensional plane of 
pixels evenly spaced in both horizontal and vertical directions. The modified Sobel gradient 
tends to reduce the effects of noise. 



1 


72 


1 


0 


0 


0 


-1 


-72 


-1 



-1 


0 


1 


-72 


0 


72 


-1 


0 


1 



dx dy 

Figure 1 1 . Modified Sobel gradient edge detector. 



1. Pixel Gradient Computation 

To compute the pixel gradjent magnitude, we let P be the set containing the eight 
surrounding pixels P with indices (i,j) known as location P(i,j) shown in Figure 1 1 . 
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Figure 12. The set P of all eight pixels surrounding pixel P(/j). 



We define the bi-directional gradients gx(zj) and gy (/,/) by multiplying the 
corresponding weights in the Sobel edge detector matrix by the corresponding pixel 
intensity values in P. 



g,0V) = -P(i ~ 1 J - 1 ) - 2 P(i - 1 j) - P(i - 1 J + 1 ) 

+ P(/+ 1J-1) + 2P(i + lj) + P(/+ lj + 1) 

g y (v) = P(i-\J+\) + 2P(iJ +l) + P(i+\J+l) 
-P(i- 1 j- 1 ) + -2P(iJ - 1 )-P(i+ lj- 1) 



(Eq 2) 
(Eq 3) 



The bidirectional gradients g x(/j) and gy(/j) represent the change in pixel 
intensities in the horizontal direction (Jjc) and the vertical direction (dy) at pixel location 
P(/ j). With these gradient components, the pixel Gradient Magnitude G(i,j) is calculated by 



G(iJ) = J(g x (ij)) 2 + (g y (ij)) 2 (Ec l 4) 

and the Gradient Direction is calculated by 

OO'j) = atan2 (g y (ij), g x (ij)) (Ec l 5) 

where atan2 is the subroutine function defined in Appendix A. 
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B. PROPERTIES OF AN EDGE REGION 



We define the edge region as that boundary where the intensity level of the pixels 
is changing rapidly or whose pixels has a significant gradient magnitude. A pixel that has 
been included in the edge region must be significant, i.e. have a gradient magnitude greater 
than the specified threshold value. Threshold value can be determined dynamically by 
scanning the image once and computing the average weight of pixel intensities or by 
maintaining a histogram of previous images’ average pixel intensities. For any two pixels 
to belong to an edge region, the pixels must be adjacent to each other and the pixels must 
have close gradient direction angles. We define closeness as the difference between the two 
pixel’s gradient direction angles as being less than some constant angle <(> . 

A portion of an image with the edge region R between two distinct areas of common 
light intensity (areas A and B) is shown in Figure 12. Pixels included in the edge region R 
will have an average gradient direction angle close to the normal of the line segment 
describing that region. 




Figure 13. Edge region between two areas of common light intensity. 
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A pixel will not be included in the edge region if its gradient angle is not close to 

the region’s average gradient angle d>ovg. Thus, determining the pixels gradient angle and 
comparing the regions average gradient angle is crucial to the initial process of edge 
detection. 

Another important property of the edge region is the number of pixels that have 
been included in the region. Regions that consists of relatively small amounts of pixels 
produces a line extraction image with many broken line segments. One cause for generating 
regions with a relatively small amount of pixels can be attributed to random variations in 
the image, termed noise [BAL82]. 

C. EDGE REGION ALGORITHM 

1. Scanning Image 

The image is scanned starting from the origin at pixel location (0,0) and continues 
to be scanned from left to right, bottom to top as shown in Figure 13. 

2. Adjacency Test 

Once the pixel’s gradient magnitude G (i,j), gradient direction 0(/j), and 
significance have been determined, the pixel is then examined to be included in a region. 
The adjacency test evaluates the current pixel at location (i, j) and compares its gradient 
direction with each of four adjacent pixels to determine gradient direction closeness. The 
adjacent pixels are the pixel to the left (i-1, j), the pixel below (i, j-1) and its left ( i-J,j-l ) 
and right (i+1, j-1) neighbors as shown in Figure 13. 
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Figure 14. Direction of scanning an image. 



3. Pixel Inclusion In a Region 

The pixel being evaluated is included in a region of existing pixels of adjacent 
neighbors that have close gradient directions and are significant. If the pixel does not meet 
the criteria to be included in a region, a new region is created with this pixel as the start of 
the new region. 

For any two pixels (i,j) to be included in one region, R, the following conditions 
must exist: 

- Pixels (i,j) and R must be adjacent. 

- The difference between the gradient direction 0(1 J) of pixel (i,j) and the 

average gradient direction O ave of the region R is less than some specified angular 
difference <t> . 

If a pixel is adjacent to more than one significant pixels that are included in the same 
region, the new pixel will be included in that region if it meets the above conditions, 
otherwise it will be part of a new region. 
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D. LINEAR FEATURE EXTRACTION 



Once the gradient image is constructed, we must provide a method for recognizing 
the sets of data points or pixels which form the linear feature of the region and a method 
for finding and describing the line segment that best fits these sets of data points. The 
method used for determining a line segment from the two-dimensional region of data points 
is by least squares fitting. In the gradient image, the moments of pixel locations (jc, y pixel 
coordinates of the image) for all pixels in the region are computed to obtain the line 
segment for the regions’s major axis. This line segment continues to grow until certain 
measures of the line segment indicate that the line segment should be ended and a new one 
started. We use an implementation of least squares fitting described by [KAN90]. 



1. Least Squares Fitting 

Suppose we have collected n consecutive valid data points in a local coordinate 
system, (p h ..., p n ), where p t = (jt„ y,) for i = 1,...,«. We obtain the moments m jk of the set of 
points 



m jk = ^ xi i y k i ( 0 < j, k < 2, and j + k < 2) 

/ = l 



Notice that m 0 „ = «. The centroid C is given by 



C = 



^10 ^01 
y m 00 m 00 J 






The secondary moments around the centroid are given by 



(Eq 6) 



(Eq 7) 
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(Eq 8) 



(Eq 9) 
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We adopt the parametric representation (r,a) of a line with constants r and a. If a 
point p = ( x,y ) satisfies an equation 

r = xcosa + ysinoc (~n/2<a<n/2) (Eq 11) 

then the point p is on a line L whose normal has an orientation a and whose distance from 
the origin is r as shown in Figure 14. This method has an advantage in expressing lines 
that are horizontal to the X axis. The point-slope method, where y = mx + b, is incapable of 
representing such a case = b is undefined). 




Figure 1 5. Representation of a line L using r and a. 



The residual of point p, = (x ; , y,) and the line L = (r,a) is x-cosa + y-sina - r . 
Therefore, t the sum of the squares of all residuals is 



5 = 



n 

(r- jt.cosa -y.sina) 



(Eq 12) 



i = 1 

The line which best fits the set of points is supposed to minimize S. Thus the 
optimum line (r,a) must satisfy 



dS _ dS 
dr da 



(Eq 13) 
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Thus, 



— = 2^ (r-jt-cosa-^sinoc) 
i = 1 
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= 2 (rm 00 -m, 0 cosa-m 0] sina) 

= 0 



(Eq 14) 

(Eq 15) 
(Eq 16) 



1U U1 

r - — cosa + — sina = li cosa + u. sina (Eq 17) 

m oo m oo y 



where r may be negative. Substituting r in Equation (12) by Equation (17), 



n 

S = 2 ( (* { --^ jr ) c °sa+ (y,-|4 y ) sina) 2 (Eq 18) 

i = 1 



Finally, 

n 

■£ = 2 2 ((^-^) cosa+ (>«-^) sina )(-( x ,-^) sina+ (>'r^) cosa ) ^ l9) 

i = 1 

n n 

= 2 2 (( y i -fl : y) 2- ( X j -M jt) 2 ) sinaCOSa + 2 2 ( X i~^)( y i _>1 y) (COs2a ' Sin2a) < Ec l 20 ) 

i=I i=l 

= (M 02 -A/ 20 ) sin2a + 2M n cos2a (Eq 2 1 ) 

= 0 

Therefore 



atan (2M,,/ (M Q2 -M 20 ) ) 

a = — - — (Eq 22) 

Equation (17) and Equation (22) are the solutions for the line parameters generated 
by a least squares fit. 
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2. Finding Endpoints 

The residual of a point p, = ( x„ >-,) is 



5, = (H*-*,) c osoc+ sin a 



(Eq 23) 



Therefore, the projection, p' . of the point p, onto the major axis of the distribution 
Ellipse is 



We will use p', and p' n as estimates of the endpoints of the line segment L obtained 
from the set p of data points. 

3. Line Segment Validity Test Of Edge Region 

The equivalent ellipse of inertia in Figure 15 for the edge region, R, will have the 
same moments about the centroid (M 2 „, M„, and M m ) as R. M major and M min „„ the moments 
about the major axes of the ellipse, are defined as: 



Pi = ( x i + 8 ( cosa, y. + 5 ( sina) 



(Eq 24) 




(Eq 25) 




(Eq 26) 



The lengths of the major and minor axes, d major and d mmor are: 



major 




(Eq 27) 




(Eq 28) 
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equivalent ellipse of inertia 




Figure 16. Equivalent ellipse of inertia. 



We consider the major axis to be the line segment L, for the edge region. The 
endpoint of the major axis will be the endpoints for the desired line segment. The 
projections of the first and last pixels, p and p associated with the region R, will therefore 
be used as estimates for the two endpoints of L. A ratio, p , of the axes length can then be 
used to describe the thinness of the ellipse. 



P = 




(Eq 29) 



Using the values for number of pixels ( m (K) ), major axis length (d major ), and the ellipse 
thinness ( p ) as parameters for comparison to edge region significance, edge length and 
how much the edge region resembles a line can be simply tested as long as the least squares 
fits moments are maintained for every pixel included in an edge region. Let C,( 0 < C 3 < 1 ) 
be a constant for the maximum allowable ratio p that can be used to describe a line. Let C 4 
be a specified constant for the minimum number of pixels and C 5 for the minimum line 
length. Three requirements can therefore be specified for the line testing of an edge region. 
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1 . The ratio of axes length is less than the maximum rho (p < C 3 ) , 

2. The number of pixels is greater than the specified minimum ("*oo > C 4 ) , and 

3. The line length of the region is greater than the minimum length (d ma}or > C 5 ) . 

The ratio p proves to be the most significant measurement. For p to equal 1.0 
means that the length of the minor axis is equal to the length of the major axis, representing 
an edge region that resembles a circular blob. Therefore, p can be compared to a maximum 
ratio, Cj, specified by the user. C 3 equal to 1 .0 allows all edge regions to be considered thin 
enough to represent a line segment. A value of 0.1 seems to work well. 

The two other tests can be used to trim down the number of smaller, less significant 
line segments. The regions that meet these requirements will be saved for the desired output 
as the found line segments and all the other regions will be discarded. 

E. EDGE EXTRACTION RESULTS 

The edge region algorithm and the linear feature extraction described in the 
previous sections were implemented in the testedge algorithm detailed in Appendix A. The 
results of the input matrix images are shown in the following figures. Figure 16 shows the 
generation of edge regions from the square matrix image previously shown in Figure 4. 
Figure 17 is the line segment extraction of the square image in Figure 16. 
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Figure 17. Edge region generation of matrix square image. 




Figure 18. Line segment extraction of edge region of square image. 



Figure 18 through Figure 23 show the matrix images and line segment results of 
more sample images. 
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Figure 19. Two light intensity values of 12 by 12 matrix sample image. 




Figure 20. Line segment extraction of above image. 
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Figure 21. Three light intensity values of 12 by 12 matrix sample image. 



[y axis 




Figure 22. Line segment extraction of above image. 
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Figure 23. Two light intensity values of 12 by 12 matrix sample image. 




Figure 24. Line segment extraction of above image. 
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The edge region algorithm and the linear feature extraction described in the 
previous sections were implemented in the findedge algorithm detailed in Appendix B. The 
results of an actual input images shown in the following figures. The images shown in 
Figure 24 and 27 produces the gradient images shown in Figures 25 and 28 respectively. 

The extracted line segment features are shown in Figures 26 and 29. The Five 
parameters for gradient threshold and line segment properties C, through C 5 were 
determined by trial and error to achieved the best line segment extraction. 



27 




Figure 25. Input image of hallway. 




Figure 26. Gradient image of hallway. C,= 80.0, C 2 - 15.0degrees. 




Figure 27. Line segment extraction via findedge implementation. C, = 1.0, C 4 = 10 pixels. 



C 5 = 10.0. 
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Figure 28. Input image of room comer. 




Figure 29. Gradient image of room comer. C, = 80.0, C 2 = 20.0 degrees. 




Figure 30. Line segment extraction via findedge implementation. C, = 0. 1 , C 4 = 7 pixels, 

C 5 = 7.0. 
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The results of both line segment extractions can be refined by varying the 
parameters to find the best line segment output. However, this method is tedious and not 
ideal for implementation on board a robot operating in a dynamic environment. For this 
reason, we assume that the interior lighting level will remain relatively constant while the 
robot traverses its environment. An input image taken by the robot will be processed with 
a common set of edge region and linear feature parameters. These parameters could be 
established based on heuristics of various input images the robot would see in its 
environment. The parameters used for this test were varied slightly to improve the line 
segment extraction. The parameters were also left the same for all input images and the 
results were compared with the images in which the parameters were varied. However, no 
significant changes were seen in the line segment extraction of the images. Examination of 
the line segment extraction results are consistent and enables further processing for pattern 
matching and pose determination [PET92]. 

Figures 30 through 32 demonstrate the ability of the findedge algorithm to 
discriminate details of an input image. This ability is ideal for object identification. 
Extracting enough information from an image could provide additional three-dimensional 
data to enhance the “intelligence” of the robots’s obstacle avoidance maneuvers. 
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Figure 3 1 . Input image of a printer. 




Figure 32. Gradient image of printer. C,= 70.0, C 2 = 15.0 degrees. 




Figure 33. Line segment extraction via findedge implementation. C, = 1 .0, C< = 7 pixels, 

C 5 = 7.0. 
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An implementation of object identification on Yamabico is the alignment method 
[ULL91]. The basic premise of this approach is that given a known set of feature points for 
a known object and the same points on an unknown object, it is possible to map the two sets 
via constant coefficient linear equation if they are alike. The powerful aspect of this 
relationship is the fact that it is valid regardless of rotational/and or translational 
differences, permitting direct analysis of image objects according to the object database. 
[DEC93], Once classifying an object, the ability to obtain object depth allows for obstacle 
avoidance measures based on image processing. 
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V. IMAGE TO SPARC BOARD INTERFACE 



A. SPARC BOARD DESCRIPTION 

Yamabico's IV-SPRC-25A CPU board has 16Mbytes of DRAM, located in the lower 
portion of the 4Gbyte address space. The address space above this 1 6Mbytes is devoted to 
VME bus use. It contains several memory regions as shown in Figure 33. The address space 
above these VMEbus regions is reserved for EPROM and board configuration 
registers.There are three logical mappings to the VME bus: the cluster-internal virtual bus, 
the synchronous Mbus and the asynchronous T-bus. All of Yamabico’s address space has 
been mapped using the T-bus. 

The VMEbus interface which resides on the T-bus allows operations with Motorola 
68020 type protocols. A T-bus master may only access other T-bus devices and local 
DRAM. T-bus features are: 

- Fully asynchronous bus 

- Separate 32-bit address and data buses 

- Four Gigabytes of physical memory address space 

The T-bus 32-bit address space is conceptually divided into seven regions. Some of 
these regions are fixed and others have programmable sizes. Figure 33 shows the default 
address space which was used in this system. The space is initialized by resident 
initialization code in the Ironies SPARC CPU card. There are two regions which involve 
the Yamabico's image subsystem: Region 3 and A24 space [KIS95]. 
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Figure 34. VME mapping of image modules into SPARC-4 address space [KIS95]. 
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1. Region 1 Address Space 

Region 1 supports the same three addressing modes as region 3. It can deliver data 
as 16 or 32 bit blocks. The region starts at the end of local DRAM space and extends 
through the address specified in the Boundary 2 address register (0xfffd0600). The 
attributes of this region are set in the Region 1 Attributes register (0xfffd0900). The Ironies 
initialization code maps region 1 to the VMEbus as A32/D32. 

2. Region 2 Address Space 

Region 2 supports the same addressing/data modes as region 1 and 3. It starts at the 
end of region 1 extending up to the start of region 3. 

3. Region 3 Address Space 

Region 3 starts at the end of region 2 and extends to the bottom of the EPROM 
address space (OxffOOOOOO). The attributes of this region are set in the Region 3 Attributes 
Register (OxfffdObOO). The Ironies initialization code initially sets up this region for 
addressing and data which contain 32 bits (A32/D32). To avoid conflicting with the address 
space used by the sonar, the image board can be offset from the base address of this region 
up to OxffOO in 0x100 intervals. The default offset, 0x0600, was chosen for Yamabico since 
it does not conflict with the VME address space for the sonar or the dual axis controller 
registers. The sonar registers are mapped to 0xfc008000 and the image board is mapped to 
0xfc000600 and uses 64 words (0x00-0x70- 

The image board addresses in this region are used to set initial configuration of the 

image board. This includes setting up address space for the actual images and additional 

modules such as the acquisition module and the display module. Configuration information 

stored in this region includes: 

Size mapped into VME memory space (image memory) 

Address space desired (24 bit of 32 bit) 

Input frame masking bits 

Page selection (image, acquisition module, display module 
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4. A24 Space 

The A24 space contains the actual images plus the acquisition module registers and 
display module registers. This region can overlay all three regions previously discussed. It 
can start anywhere from the top of local DRAM up to the bottom of EPROM address space. 
Yamabico ' s image subsystem uses the Ironies default for this region which is from 
OxfaOOOOOO to Oxfbffffff. The default setting also assumes a 16 bit data width for the slave 
board. This default setting is also used, although data can be up to 32 bits wide. 

B. IMAGE BOARD DESCRIPTION 

1. Standard Image Manager (IMS) 

After setting up the A24 Space attributes some IMS configuration registers must be 
set to allow the acquisition module registers to map to this region [ITIIMS93]. These 
include the IMS configuration register, and page select registers. The IMS status register 
can also be checked to confirm that the IMS board is present. The configuration register 
contains bits that set the amount of memory to be mapped to VME address space and allow 
selection between standard (A24) or extended (A32) addressing. In the A32 mode, the high 
byte of the configuration register configures the upper 8-bits of the memory base address. 

As shown in Figure 33, the acquisition module is mapped to OxfaOOOOOO, which is 
the beginning of A24 space. Standard addressing (24 bits) was selected with a map size of 
1MB. Module register access is not affected by this mapping size. With a map size of 1 
Mbyte, the three images, the acquisition module registers and display module registers can 
be mapped to VME address space using the page register. The page register allows the 
setting of pixel size, choice of enabling or disabling VME memory access and the choice 
of selecting either one of three memory pages or the acquisition and display modules. 
Initially the page register is set to access the acquisition module registers through VME 
memory addresses. Figure 34 shows the flow of pixel data through the image manager. 
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Figure 35. Standard Image Manager (IMS) [ITIIMS93]. 



2. Acquisition and Display 

The IMS board is supported by two smaller plug-in modules: the Acquisition 
Module and the Display module. The Acquisition module provides an interface between 
the camera and the IMS board. The display module is described in the next section and 
interfaces with a display monitor. 
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a. Acquisition Module (AM) 

The acquisition module is produced by the same company as the main image 
board (Imaging Technology Inc.)[ITIAM93]. It is designed to interface with many different 
cameras and operate in a variety of modes. This is both an advantage and a hinderance since 
the 17 registers augmenting the 43 registers on the main image board must all be 
programmed. The module itself can receive up to 24 bits in parallel, but the camera chosen 
is only an 8 bit grayscale. Our 8 bit version uses a RS-422 for data input. The camera’s 8 
bit pixel data is first stored into a 4k by 8 bit FIFO queue and then transferred to the 
motherboard. In the 8 bit version of ITI’s acquisition module the 8 bit camera data is passed 
directly to a 4K by 8 bit FIFO queue. The 8 bits are duplicated on three output channels. 
Since our camera is an area scan device, the acquisition module outputs horizontal and 
vertical frame timing to the mother board based on the line enable, frame enable and pixel 
clock inputs from the camera [KIS95]. 

b. Display Module (DM) 

The DM-PC Pseudocolor Display Module (DM) is a plug-module for the image 
manager. It provides a medium resolution pseudocolor RGB display for many types of 
monitors including 1024 by 768 non-interlaced and up to 1024 by 1024 interlaced 
monitors. It receives 8 bits of image data from the mother board (IMS module) and converts 
it into RGB pseudocolor. Overlay memory is supported for applications requiring graphics 
to overlay images. The heart of the display module is the Texas Instruments TMS34010 
Graphics System Processor (GSP) which controls all graphics and image display functions. 
All display module registers are in-turn mapped to the GSP registers. The pseudocolor 
transformation is performed by a Bt478 RAM digital-to-analog converter (RAMDAC). All 
options for displaying are software programmable. The route of data through these 
components is shown in Figure 35. 
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Figure 36. Display Module analog conversion block diagram [ITIDM92]. 



The display module displays an image that is stored in frame B1 of the IMS 
mother board. Therefore it does not do any processing on the image, other than the mapping 
that is done to display the image in a RGB format. The DM does support an overlay which 
can be programmed to display menus or text. This feature may be used in later research to 
display lines generated by edge finding software. 

The RAMDAC uses a look-up table (LUT) for the mapping of the 8 bit grayscale 
image on to a 24 bit RGB display image. There is also program memory available on the 

GSP which can be used to store operation code, such as the TIGA™ graphical user 
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interface. There are three main hardware components for converting eight bit digital data 
into an analog video output: 

- Three Digital to Analog Converters (DAC) 

- DAC LUT (look-up table) 

- Overlay Color Table 

- Pixel Mask 

Figure 35 is a block diagram which shows the flow of data within the display 
module. The 8 bit image first passes through the pixel mask which allows the programmer 
to strip bits from each pixel. This could be used to limit the number of values used for each 
shade of gray and therefore, certain thresholds of differences between grayscales. For 
example, if only two values were required for further image processing, the pixel mask 
could be set to 1000 0000 binary. This would map the grayscale input to either 00 or 80 
hexadecimal and any pixel with a grayscale of 127 or less would be displayed as white and 
any pixel with a value greater than 127 would become gray. 

After exiting the pixel mask, the pixel data is transformed into a pseudocolor 
image with the DAC LUT. The DAC LUT consists of red, green and blue triplet bytes that 
contain the conversion value for each color. Because we want to see a grey scale 
representation of the image, we have coded the DAC LUT to echo the value of the pixel for 
all three colors. The DAC LUTs could be used to accent a certain value, perhaps a threshold 
value of interest. In that case when a pixel with the threshold value was received, the green 
and blue DAC LUTs could output a 0x00 will the red outputs Oxff. This would cause all 
pixels with the value of interest to be displayed in red. 

The final processing that takes place prior to the image being displayed is 
combining an overlay with the image. The overlay memory consists of 1024x1024x4 bits 
of data. When the value of the 4 bits is zero, no overlay is displayed. The other 15 values 
can be obtained from the 4 bits and will override the image data with colors from a overlay 
color table. This table is accessed the same way the DAC LUT does with red, green and 
blue data obtained for each pixel [KIS95]. 
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VI. IMAGE UNDERSTANDING SYSTEM ON YAMABICO-11 



A. OVERALL FUNCTIONALITY 

The image understanding system on Yamabico-11 incorporates the real-time 
processing capabilities of the Single Board Super Computer System, SPARC™ CPU, and 
the image processing system of the Standard Image Manager (IMS) VME Board described 
in Chapter V. The recent installation of a COHU digital output camera coupled with the 
image board yields a higher system resolution and NTSC grayscale compatibility than the 
previous implementation of the JVC CCD camera described in Chapter II. 

The image understanding system is partly based on edge extraction and line fitting 
algorithms of [PET92] with a 3-D geometric model of the robot’s world [STE92]. By using 
image grabbing routines of [KIS95], images are captured with the digital output camera 
installed on the robot. An image recording feature called the image log, similar to that of 
the motion and sonar log, was developed to store the captured image in the robot’s memory 
for downloading to a workstation for further analysis. 

By porting image understanding routines previously developed for a Silicon 
Graphics Iris (SGI) workstation and modifying the routines for compatibility with 
Yamabico’s image memory structure, the robot now has the ability to process images on- 
board. 

B. INITIALIZING IMAGE MANAGER 

The standard image manager’s initialization routine first sets the paging register to 
allow selection of frame memory, acquisition registers or display registers. The display 
initialization routine is called first. It is followed by the acquisition initialization routine. 
The frame masks are then cleared to allow 8 bits of pixel data to pass to each frame. Two 
control registers are then set. The first is for the image manager, which sets the clock 
frequency, along with enabling display and acquisition. More information on image 
initialization and routines can be found in [KIS95]. 
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C. ACQUIRING IMAGE WITH SNAP COMMAND 



1. setlnputPath 

This routine selects the camera input as the source of the image and puts the image 
in frames AO, Al, Bl, where it will reside: 

- setInputPath(AO, CAMERA); 

- setInputPath(Al, CAMERA); 

- setInputPath(B 1 , CAMERA); 



2. setFrame Acquire 

This routine sets up frames to receive a single image. The image operation is 
actually executed by the “acqEnable” command. 

- setFrameAcquire(AO, SNAP); 

- setFrameAcquire(Al, SNAP); 

- setFrameAcquire(B 1 , SNAP); 

3. acqEnable 

This routine initiates the snap operation specified. Prior to this operation, frame B 1 
is waiting and ready to receive the image. This command starts the acquisition. The 
command has no function call parameters: 

- acqEnable(); 

D. FORMATTING IMAGE FOR PROCESSING 

Combining the operations from the previous section, allows the formation of the 
primitives needed to format an image. The support routines used are described in [KIS95]. 
1. Log and snap an image in frame Bl for processing 

- setInputPath(B 1 , CAMERA); 

- ImageLog(NULL, 0) 

- setFrameAcquire(B 1 , SNAP) 
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- acqEnable(); 

- copylmageToMemory(Bl); 

The following code segment copies the image to memory as a two-dimensional 
array. This was needed for compatibility of the edge extraction and linear fitting 
algorithms. 

YAMAIMAGEbl Image; 
void 

copyImageToMemory(IMSPage frameNumber) 

{ 



unsigned long page 1 Index = OxfaOOOOOO; /* First empty line for pg2 pixels */ 
unsigned long page2Index = 0xfa07a400; /* First IK of pixels on page 2*/ 
unsigned long page 1 Source = OxfaOOOOOO; 
unsigned long page2Source = 0xfa07a400; 
intij; 

int xSize = 732; 
int ySize = 476; 
bl Image. xSize = xSize; 
bllmage.ySize = ySize; 



for(i=0; i<238; i+=2) 



for (j=0; j<366; j+=2) /*732 bytes but 2 bytes per access*/ 

{ 

bl Image. image[i][j] = *(BYTE*)pagel Source; 
page 1 Source += 2; 

bllmage.image[i+l][j] = *(BYTE*)page2Source; 
page 1 Source += 2; 



page 1 Index += 0x800; 
page2Index += 0x800; 
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page 1 Source = page 1 Index; 
page2Source = page2Index; 



} 

LogImage(b 1 Image); 

} 



E. IMAGE UNDERSTANDING FOR MOTION PLANNING 

Sonar research [MAC93], [LOC94], has been the basis of motion planning for 
Yamabico-X 1 and has provided improvements in robot positioning accuracy. However, the 
integiation of an image understanding system enhances the overall sensor capabilities of 
Yamabico - 11 and is the first step towards achieving complete and/or integrated visual 
navigation control. Various methods for implementation of a visual navigation system 
utilizing a single image have been pursued by [STE92], [PET92], and [DEC93]. Another 
approach of incorporating stereo vision for navigation is addressed by [KRI89]. 

One method is to store a model line segment image in the robot and match it with 
the actual line segment extraction data computed via the robot image processing system. 
By conducting pattern matching of both images, the capabilities for robot position 
correction, vehicular navigation, as well as object identification and recognition exists thus 
enhancing the visual navigation system. 

An example of a path generation [DEC93] problem can be used to execute the 
following algorithm: 

- Snap an image while traveling along a particular path. The robot sees the 
actual image in Figure 34. 

- Perform image analysis on the image. A model line segment image shown 
in Figure 35 has been downloaded into the robot and compared with the computed line 
segment extraction performed on the robot shown in Figure 36. 

- If no object is detected, continue on the current path. Shown in Figure 36 

- If an object is detected, analyze object for range and dimension information. 
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- Determine the ‘safest’ and least significant maneuver and compute the 
required distance to shift left or right. 

- Define a new path based on the above input and transition to it or return to 
the original path once past the object, as detected by side-looking sonar. Shown in Figure 
37. 




Box object in 
hallway 



Figure 37. Hallway image with object. 
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Figure 40. Yamabico-1 1 image motion planning. 

These elements for path generation provide a richer sensing capability but may be 
limited due to physical hardware and software limitations of the robot. One software 
problem discovered by [KIS95] was the impact of the image system on the operation of 
other systems. The integration of the image understanding system into the motion control 
and sonar control could have resulted in several changes to MML but was avoided to permit 
development and testing of both images routines and MML separately. Other studies for 
combining vision with motion planning can be seen in [LUM88]. 

The capability of combining motion and sonar control by embedding image 
commands in the user.c routine and processing the image while the robot traverses its 
environment provides the framework for future image understanding needs for motion 
control. 
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VII. CONCLUSION 



A. OVERALL RESULTS 

The overall result of this research effort is an autonomous mobile robot that can 
now successfully capture and process an image on-board by finding straight edges in a 
grayscale (black and white) image. 

An image log was developed to record image data and provide downloading of the 
image from the robot to a workstation for further processing. By analyzing the image data, 
previously developed Silicon Graphics image understanding routines were able to be 
modified for compatibility with the robot’s memory structure. These routines were ported 
onto the robot’s Single Board Super Computer System and provides Yamabico-1 1 with the 
on-board, real-time image processing capabilities. 

These features provide the foundation for future developments of a real time 
dynamic visual navigation system for an autonomous mobile robot. 



B. FOLLOW-ON WORK 

Although this research effort has improved the image processing capabilities of 
Yamabico- 1 1, there remains much work to be done. The following are some possible areas 
of follow-on work. 



1. Sensor Integration 

The combination of sonar and vision capabilities can provide Yamabico with even 
greater information of its environment. Integrating the two sensors can improve the robot’s 
obstacle detection, position determination, and object recognition abilities. 
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2. Image Processing Algorithm 

In order for Yamabico to be successful in a dynamic environment, the vision system 
must provide the robot with the ability to quickly assess its surroundings and navigate with 
safe and smooth motions. The governing principle behind Yamabico 's ability to react is the 
algorithm used to compute the edge extraction. The method used in this work for scanning 
an image is cumbersome and increases processing time. Other methods such as arbitrarily 
picking a pixel location in an image based on random sampling is currently being pursued 
among the vision research group. This method appears logically to be more efficient and 
suitable for a robot operating in a dynamic environment. 

3. Embedding Image Understanding Software in MML 

Embedding image understanding routines in Yamabico ’s MML system can enhance 
the image understanding capabilities of the robot. Newly developed path planning software 
may allow the robot to operate independently for longer periods of time. An interrupt 
driven image understanding routine could continually look for obstacles independent of the 
other systems. 

4. Color Image Analysis 

Yamabico’ s black and white camera was chosen to allow a grasslike computation 
of edge and line segment extraction routines which are more easier to compute than a 
colored image. However, the additional information in a colored image may increase the 
robot’s ability to recognize edges in an image. The detection of a change in the surface’s 
RGB value may allow the robot to find more significant edges. 
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APPENDIX A - TESTEDGE ROUTINES 



The following routines provide implementation for the edge region 
extraction and line segment extraction. Given an input matrix image the 
algorithm determines the edge regions for the gradient image and produces 
the line segment extraction . The files included are the following: 
types. h, linesupport . h , testedge.c. They are located in the -yamabico/ 
vision95 directory. 

/★****★************★*★**★★★****★*★*★************★***★*****★************/ 
/*file types. h 
/* 

/*This file holds the structure definitions for edge extraction and linear 
/^fitting routines. 

/ * Types defined :EDGE_REGION_TYPE 
/* PIXEL_INFO 

/* POINT_TYPE 

/ * LINE_TYPE 

/★************★★★**★*★★*******★★*★*★★★*★★★***★***★*★*★★★******★*****★**/ 
typedef struct edge_region_type 
{ 

int first_pixel; 
int last pixel ; 
double avg_phi; 
double sum_phi; 
int reg_num ; 
double mOO ; 
double mlO ; 
double mOl ; 
double mil ; 
double m20 ; 
double m02; 

struct edge_region_type *next ; 

} REGION; 



typedef struct pixel_info 

{ 

double phi ; 

REGION *r ; 

int significant; 

} PIXEL ; 

struct point_type 

{ 

double x,y; /* x,y coordinates of the pixel endpoints */ 
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typedef struct point_type POINT; 



typedef struct match_type 

{ 

/* LINE *line;*/ /* ptr to LINE type (from Jim Stein's " graphics . c M ) 

*/ 

double angle_view_di f f ; /* angular difference between image and model 

lines in the image */ 

float conf ; /* confidence value for the match */ 

float dist; /* distance between the *match LINE and IMG_LINE */ 
float scale; /* ratio IMG_LINE->dma j or / MODEL_LINE-> length */ 
struct match_type *next; 

MATCHTYPE ; 



typedef struct line_type 

{ 



char name [ 3 ] ; 

POINT pi, p2; /* the 2 endpoints for the line */ 

struct line_type *next; /* ptr to the next IMG_LINE in the image */ 



/* Least Squares Fit momments: 



int mOO; 



/* Number of pixels */ 



double mlO; /* 
double mOl; /* 
double mil; /* 
double m20; /* 
double m02 ; /* 
double phi; /* 
double dmajor; /* 
double dminor; /* 
double rho; /* 



Sum x * / 

Sum y * / 

Sum x*y */ 

Sum x*x */ 

Sum y*y */ 

Calculated normal orientation of IMG_LINE */ 
Length of major axis of equivallent ellipse */ 
Length of minor axis of equivallent ellipse */ 
Ratio dminor/dma jor */ 



/* Pattern Matching Information: */ 

double angle_to_image_center ; 

MATCHTYPE *matchlist; /* List of matches to LINE types */ 

MATCHTYPE *pm; /* present match being considered */ 



} IMG_LINE; 
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/ * file atan2 . c 
/* 

/*This file provides a definition of the atan2 ( ) function. 
#def ine PI 3.141592653589793 
double atan2(y,x) 



double 


x, 


y; 














if (x > 


0. 


0) return 


( arc 


tan (y/x) 


) ; 






else 


if 


( (X 


< 0.0) 


ScSc 


(y > 0.0 


) ) 


return ( 


arctan(y/x)+ PI) ; 


else 


if 


( (X 


< 0.0) 


ScSc 


(y < 0.0 


) ) 


return ( 


arctan(y/x) - PI); 


else 


if 


( (X 


< 0.0) 


ScSc 


(y == 0. 


0) ) 


return 


(PI) ; 


else 


if 


( (X 


= =0.0 


) ScSc 


(y > 0. 


0) ) 


return 


(PI/2.0) ; 


else 


if 


( (X 


==0.0 


) ScSc 


(y < o. 


0) ) 


return 


(-PI/2.0) ; 


else 


return 


(0.0) ; 












★★★★★★★ 


★ ★ ★ 


★ ★ ★ ★ 


★★**★***★* 


★★★★★★★★ 


★ * * 


★★★★★★★★ 


★*★**★***★★*★★★** 



/ * FILENAME : linesupport . h 

/* AUTHOR: Leonard V. Remias and Khaled Morsy 
/ *DATE : 01 October 1995 
/* 

/ ^DESCRIPTION : Collection of region finding functions. 

/* 

/ * IMG_LINE *create_line (REGION *r, double M2 0, double Mil, double M02, 
/* double Dmajor, double Dminor, double Rho) 

/* void fatal (char message) 

/* void line_test (REGION *r) 

int xdim;/*width of input image (nr pixels)*/ 
int ydim;/*width of input image (nr pixels)*/ 

int Linecount = 0; /*counter for number of IMG_LINEs made*/ 

IMG_LINE *Line_list_head = NULL; 



/* V 

/* void fatal (char message) 

/* 

/* Prints error message and exits out of the program. 

/* */ 

fatal (message) 

char *message; 

{ 

fprintf ( stderr , "Fatal ERROR: "); 

perror (message) ; 

exit(-l); /* exit by failure */ 
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} 



/* */ 

/* IMG_LINE *create_line (REGION *r, double M20, double Mil, double M02, 
/* double Dmajor, double Dminor , double Rho) 

/* 

/* Returns pointer to newly instantiated IMG_LINE with variables set 
/* according to moments described by REGION r, secondary moments 
/* M20, Mil, and M02, axis lengths Dmajor, Dminor, and ratio of 

/* axis lengths Rho. 

/* */ 



IMC uINE *create_line (r , M20 , Mil , M02 , Dmaj or , Dminor , Rho) 
REC ON *r ; 

double M2 0 , Mil , MO 2 , Dmajor, Dminor , Rho ; 

{ 



IMG_LINE *1; 



long xl, yl, x2 , y2 ; 
double Phi, deltal, delta2; 
int negative_jphi ; 

/ * intf ( " \nenter create_line" ) ; */ 

/* r->f irst_pixel mapped onto the IMG_LINE will be endpoint pi 
r->las t_pixel mapped onto the IMG_LINE will be endpoint p2*/ 

xl = r-> f irst_pixel % (xdim) , 
yl = r-> f irst_pixel / (xdim) , 

x2 = r->last_pixel % (xdim) , 
y2 = r->last_pixel / (xdim) ; 

/* Calculate the normal orientation of the IMG_LINE by atan2 ( ) 
function . * / 

Phi = atan2 ( -2 *M11 , M02-M20 ) /2 . 0 ; 

/* Deltal and delta2 are the offsets used to calculate the endpoints 
for the IMG_LINE segment based upon values xl,yl and x2,y2.*/ 



deltal = ( r->mlO /r->m00 - (double)xl) *cos (Phi) + 

(r->m01/r->m00 - (double) yl ) *sin ( Phi ) ; 
delta2 = (r->ml0/r->m00 - (double) x2 ) *cos ( Phi ) + 

(r->m01/r->m00 - ( double )y2) * sin (Phi) ; 

/* Phi = atan2 ( -2 *M11 , M02-M20 ) /2 . 0 ) always returns positive result to 
Phi . 
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Therefore, negative__phi = (r->avg_phi < 0.0) is necessary.*/ 
negative_phi = (r->avg_phi < 0.0); 

/* Allocate memory for IMG_LINE 1.*/ 

if ( ( 1 = ( IMG_LINE * ) malloc ( sizeof ( IMG_LINE) ) ) == NULL) { 
fatal ( " create_line : malloc\n" ) ; 

} 

/* Calculate x,y coordinates for endpoints pi and p2 .*/ 

l->pl.x = (double)xl + deltal*cos ( Phi ) ; 

l->pl.y = (double)yl + deltal*sin ( Phi ) ; 

l->p2.x = (double)x2 + del ta2 *cos { Phi ) ; 

l->p2.y = (double)y2 + delta2*sin ( Phi ) ; 



/* Copy least squares fit moments.*/ 



l->m00 


= 


r->m00 


l->ml0 


= 


r->ml0 


l->m01 


= 


r->m0 1 


l->mll 


= 


r->ml 1 


l->m20 


= 


r->m2 0 


1 ->m02 


= 


r->m02 



/* Phi is positive, but -pi < r->avg_j?hi < pi.*/ 
i f (negative_phi ) l->phi = -Phi; 
else l->phi - Phi ; 

/* Update rest of IMG_LINE values.*/ 

l->next = NULL; 

l->dmajor = Dmajor; 

l->dminor = Dminor; 

l->rho = Rho; 



l->angle_to_image_center = 0.0; /* default values for LINE matching*/ 

l->matchlist = NULL; 
l->pm = NULL; 



++Linecount ; 
strcpy ( l->name , " 
sprint f ( l->name. 



/* Increment global variable, 
") ; 

"%d", Linecount) ; 



Linecount . * / 



return ( 1 ) ; 



/* Return IMG_LINE 1.*/ 



} 

/* 

/* 

/* void write_all_lines (long x, long y) 
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/* 

/* Write to output file " lines . text " . 

/* 

write_all_lines (x, y) 

long x,y; /* the x,y dimensions of the image 



{ 

IMG_LINE *1 = Lineal ist_head; 

FILE *lines_file; 

lines_file = f open (" lines . text ", "w" ) ; 

f print f ( lines__file , " DATA FOR EXTRACTED LINE SEGMENTS \n" ) ; 

fprintf (lines_f ile, "Image size: nr pixels x axis = %d, nr pixels y axis 
= %d\n" ,x,y); 

fprintf ( lines_file , " Extracted line segments listed in order by 
length . \n\n" ) ; 

print f (" \nenter write all lines\n"); 



while (li=NULL) 

{ 



fprintf (lines_file, "%s> length = %.4f, thinness = %.4f, 
orientation = %.4f, mOO = %d\n" , l->name, l->dmajor / l->rho , l->phi # 1- 
>m00) ; 

fprintf ( lines_file , "endpoints : (%.2f %.2f) (%.2f %.2f)\n\n ,, / 

l->pl .x # l->pl .y, l->p2 .x, l->p2 .y) ; 

1 = l->next; 

} 

f close ( lines_file ) ; 

printf ( " lines found in image written to: ' lines . text ' \n" ) ; 

} 

*/ 



/* */ 

/* void wri te_all_lines (long x, long y) 

/* 

/* Write to output file " 1 ines . text " . 

/* */ 

write_all_lines (x,y) 

long x,y; /* the x,y dimensions of the image */ 

{ 

IMG__LINE *1 = Line_list_head; 

FILE *lines_file; 
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lines_file = f open (" lines . text ", "w" ) ; 

while (1!=NULL) 

{ 

fprintf (lines_f ile, " % . 2f % . 2f \n% . 2f % . 2f \n\n" , 
l->pl .x, l->pl . y, l->p2 .x, l->p2 . y) ; 

1 = l->next; 

} 

f close ( lines_f ile ) ; 

printf(” lines found in image written to: ' lines . text ' \n" ) ; 

} 



#include <stdio.h> 

#include <math.h> 

#include " types. h" 

#include " linesupport . h" 

#def ine MAX_DELTA_PHI deg_to_rad ( 15 ) 
#def ine PI 3.14159265 



/* Constants for function: void line_test (REGION *r) */ 

#define MIN_PIXELS_PER_LINE 4 /^minimum pixels allowed for a IMG_LINE 
*/ 

#define MIN_DMAJOR 4.0 /* minimum major axis length allowed */ 

#define MAX_RHO 1.0 /* maximum ratio (Rho=Dminor/Dmaj or ) */ 

/ *FILE *reg_f ile ; * / 



int gl [144]= {150,150,150,150,150,150,150,150,150,150,150,150, 

150,150,150,150,150,150,150,150,150,150,150,150, 
150,150,150,150,150,150, 150,150,150,150,150,150, 



150, 150,150, 


0 , 


0 , 


0 , 


0 , 


0 , 


0,150,150,150, 


150,150,150, 


0 , 


0 , 


0 , 


0 , 


0 , 


0,150,150,150, 


150,150,150, 


0 , 


0 , 


0 , 


0 , 


0 , 


0,150,150,150, 


150,150,150, 


0 , 


0 , 


0 , 


0 , 


0 , 


0,150,150,150, 


150,150,150, 


0 , 


0 , 


0 , 


0 , 


0 , 


0,150,150,150, 


150,150,150, 


0 , 


0 , 


0 , 


0 , 


0 , 


0,150,150,150, 


150,150,150, 


150,150, 


150, 


150, 


150,150,150,150,150, 



150,150,150,150,150,150,150,150,150, 150,150,150, 



150,150,150,150,150,150,150, 


150 


, 150 


, 150 


, 150, 


150} 


; 


{150,150,150,150,150,150, 


0, 


0, 


0, 


0, 


o, 


0, 


150,150,150,150,150,150, 


0, 


0, 


0, 


0, 


0, 


0, 


150,150,150,150,150,150, 


0, 


0, 


0, 


0, 


0, 


0, 


150,150, 150,150,150,150, 


0, 


0, 


0, 


0, 


0, 


0, 


150,150,150,150,150,150, 


0, 


0, 


0, 


0, 


0, 


0, 


150,150,150,150,150,150, 


0, 


o, 


0, 


0, 


0, 


0, 
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/*int gl [144] = 



0, 


o. 


0, 


0, 


0, 


0,150,150,150,150,150,150 


0, 


o, 


0, 


0, 


0, 


0,1 50, 150, 150, 150, 150, 150 


0, 


0, 


0, 


0, 


0, 


0,150,150, 150,150,150,150 


0, 


0, 


0, 


0, 


o, 


0,150,150,150,150, 150,150 


0, 


0, 


0, 


0, 


0, 


0, 150, 150, 150, 150, 150, 150 




0 , 


0, 


0, 


0, 


0, 0,150,150,150,150,150 



150 , 


, 150,150, 


150, 


, 150, 


150, 


150, 


150, 


150,150, 


150, 


0 


150 , 


, 150,150, 


150, 


, 150, 


150, 


150, 


150, 


150,150, 


0, 


0 


15 0, 


, 150, 150, 


150, 


, 150, 


150, 


150, 


150, 


150, 


0, 


0, 


0 


150, 


,150,150, 


150, 


, 150, 


150, 


150, 


150, 


0, 


0, 


0, 


0 


150, 


, 150,150, 


150, 


, 150, 


150, 


150, 


0, 


0, 


0, 


0, 


0 


150, 


, 150,150, 


150, 


, 150, 


150, 


0, 


0, 


0, 


0, 


0, 


0 


150, 


, 150,150, 


150, 


150, 


0, 


0, 


0, 


0, 


0, 


0, 


0 


150, 


, 150,150, 


150, 


0, 


0, 


0, 


0, 


0, 


0, 


0, 


0 


150, 


150,150, 


0, 


0, 


0, 


0, 


0, 


0, 


0, 


0, 


0 


150, 


150, 0, 


0, 


0, 


0, 


0, 


0, 


0, 


0, 


0, 


0 


150, 


0, 0, 


0, 


0, 


0, 


0, 


0, 


0, 


0, 


0, 


0 




0, 0, 


0, 


0, 


0, 


0, 


o, 


0, 0, 




0, 0, 





{150, 


150,150, 


150, 


150, 


, 150, 


, 255, 


,255, 


, 255, 


255,255,255, 


150, 


150,150, 


150, 


150, 


, 150, 


, 255, 


,255, 


, 255, 


255,255,255, 


150, 


150,150, 


150, 


150, 


, 150, 


, 255, 


,255, 


, 255, 


255,255,255, 


150, 


150,150, 


150, 


150, 


, 150, 


,255, 


,255, 


-255, 


255,255,255, 


150, 


150,150, 


150, 


150, 


, 150, 


, 255, 


,255, 


, 255, 


255,255,255, 


150, 


150,150, 


150, 


150, 


. 150, 


,255, 


,255, 


,255, 


255,255,255, 


150, 


150,150, 


150, 


150, 


0, 


0, 


,255, 


, 255, 


255,255,255, 


150, 


150, 150, 


150, 


0, 


0, 


0, 


0, 


, 255, 


255,255,255, 


150, 


150,150, 


0, 


0, 


0, 


0, 


0, 


0, 


255,255,255, 


150, 


150, 0, 


0, 


0, 


o, 


0, 


0, 


0, 


0,255,255, 


150, 


0, 0, 


0, 


0, 


0, 


0, 


0, 


0, 


0, 0,255, 


0, 


0, 0, 


0, 


0, 


0, 


0, 


0, 


0, 


0, 0, 0} 



double dx , dy, threshold = 90; 
double orientation, min; 

long xdim=12; 
long ydim=12; 

int neighbor_included; 
int i ; 

int region_f ound_on_the_row; 
int neighbor_included; 
int x, y; 

PIXEL current [12], prev[12]; 



REGION * f irst__region ; /* head of the linked list of regions */ 
REGION * last_region ; /* last region in the list so far */ 

REGION *reg; 
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/★★★*★********************★********★*************★*************★★★*** 
FUNCTION : deg_to_rad ( ) 

PURPOSE : convert degree to radian 

★ ★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★•A:* i 



double deg_to_rad ( theta) 
double theta; 

{ 

return theta * PI/180; 

} 

FUNCTION : normalize () 

PURPOSE : return the normalized value of orientation 

★ ★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★■it***** j 

double normalize (o) 
double o; 

{ 

int d = 0 ; 
d= (o+PI) / ( 2 * PI ) ; 

if (d>=0) 
d=d+l ; 

o = o - ( 2 *PI * (d- 1 ) ) ; 

return (o) ; 



void update (current , x, y) 

PIXEL current [ ] ; 
int x,y; 

{ 

REGION *reg; 
double o; 

o=current[x] .phi; 
reg=current [x] .r; 
reg->last_pixel = i; 
reg->sum_phi+=o ; 

++reg->m00 ; 
reg->mlO+=x; 
reg->m01+=y ; 
reg->mll+=x*y ; 
reg->m20+=x*x; 
reg->m02+=y*y ; 

reg->avg_phi - reg->sum_phi / reg->m00; 
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/*fprintf (reg_file, “ \n%d %d %d" , x, y , reg ) ; */ 



) 

i 

void comparel ( current , x, y) 

PIXEL current [ ] ; 
int x,y; 

{ 

double t; 

REGION *current_region; 

t= f abs (normalize ( current [x] . phi -current [x-1 ] . phi ) ) ; 

if ( (t<= MAX_.DELTA_PHI )&&( current [x-1 ]. significant == 1)) 

{ 

min = t; 

current [xl.r = current [x-1] .r; 
neighbor_included = 1; 

} 



void compare2 (current, prev, xl, x2 , y) 

PIXEL current [ ] , prev [ ] ; 
int xl , x2 , y; 

{ 

double t; 

REGION *current_region; 

t=fabs (normalize ( current [xl ] .phi - prev [x2 ]. phi )) ; 

if ((t<= MAX_DELTA_PHI ) && (prev [x2 ]. significant == 1)) 

{ 

if (t<min) 

{ 

min = t ; 

current [xl] . r = prev[x2] .r; 
neighbor_included = 1; 

} 

} 

} 

REGION *create_region (x,y, o) 
int x , y ; 
double o; 

{ 



REGION *reg; 

if ( (reg= (REGION *) malloc ( sizeof (REGION) )) == NULL) 
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print f ( " create region"); 



reg->f irst_pixel = i; 
reg->last_pixel = i; 
reg->avg_phi = o; 
reg->sum__phi = o; 
reg->m00 = 1; 
reg->mlO = x; 
reg->m01 = y; 
reg->mll = x*y; 
reg->m20 = x*x; 
reg->m02 = y*y; 
reg->next = NULL; 

if ( f irst_region == NULL) 
first_region = reg; 
if (last_region 1= NULL) 
last_region->next=reg; 
last_region=reg; 

return ( reg) ; 

} 

void pixel_membership ( current , prev, x, y, o) 

PIXEL current!], prev[]; 
int x, y; 
double o; 

{ 

REGION *reg ; 

if (x > 1) 

{ 

comparel ( current , x, y) ; 
if (y > 1) 

compare2 ( current , prev, x, x-1, y) ; 

} 

if (y > 1) 

{ 

compare2 (current, prev, x, x, y) ; 
compare2 (current, prev, x, x+1, y) ; 

} 

if (neighbor_included==0 ) 

{ 

reg = create_region(x,y,o) ; 

/* fprintf (reg_f ile, " \n%d %d %d" , x, y, reg);*/ 
current [x] . r = reg; 

} 

if (neighbor_included ==1) 
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update ( current , x , y ) ; 

} 



/* */ 

/* void line_test (REGION *r) 

/* 

/* Determines if REGION r meets three requirements to be a IMG_LINE: 

/* (1) The number of pixels in REGION r (r->m00) be greater than 

/ * MIN_PIXELS_PER_LINE . 

/* (2) The ratio (Rho) of the length of major and minor axes of the 

/* REGION be less than MAX_RHO . 

/* (3) The length of the major axis (Dmajor) be greater than 

/* MIN_DMAJOR, the minimum IMG_LINE length allowed. 

/* If all three conditions are met, a new IMG_LINE type is created and 
/* appended to the Line_list in order of significance (in this case 
/ * Dmajor ) . 

/* */ 



line_test (r ) 

REGION *r ; 

{ 

IMG_LINE *1, *insert_pt = Line_l ist_head; 
double M20,M11,M02; 

double Ma , Mb, Mma j or , Mminor , Dmajor , Dminor , Rho ; 

/* First test -- A IMG_LINE must have a required minimun number of 
pixels . * / 

if ( r->m00 > MIN_PIXELS_PER_LINE) 

{ 

/* Calculate secondary moments by least squares fit.*/ 

M20 = r->m2 0 - ( ( r->mlO *r->mlO ) /r->m00 ) ; 

Mil = r->mll - ( (r->ml0*r->m01) /r->m00) ; 

M02 = r->m02 - ( ( r->m01*r->m01 ) /r->m00 ) ; 

/* Calculate major and minor axis lengths, Dmajor and Dminor.*/ 
Ma = (M20+M02) /2.0; 

Mb = sqrt ( ( (M02-M20 ) * (M02-M20 ) /4 . 0 ) + (M11*M11) ); 

Mmajor = Ma - Mb; 

Mminor = Ma + Mb; 

Dmajor = 4 . 0*sqrt (Mminor/r->m00 ) ; 

Dminor = 4 . 0*sqrt (Mma jor/r->m00 ) ; 

/* Calculate ratio Rho.*/ 

Rho = Dminor /Dmaj or ; 

/* Second & Third tests 

-- Ratio Rho must represent a line, not a blob. 

-- IMG_LINE must be at least a certain length.*/ 
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i f ( ( Rho < MAX_RHO ) && (Dmajor > MIN_DMAJOR) ) 

{ 

/* The REGION passed the three requirments to be a line.*/ 
1 = create_line (r , M20 , Mil , M02 , Dmajor , Dminor , Rho ) ; 



/* Add new IMG_LINE to IMG_LINE list in order by IMG_LINE 
length, dmajor.*/ 

if ( Line_lis t_head == NULL) 

{ 

Line_list_head = 1; 

} 

else if (l->dmajor > Line_list_head->dma j or ) 

{ 

l->next = Line_list_head; 

Line_list_head = 1; 

} 

else 

{ 

while ( (insert_pt->next ! = NULL) && 

(l->dmajor < insert_pt->next->dma j or ) ) 

{ 

insert_pt = insert_pt->next ; 

} 

l->next = insert_pt->next ; 
insert_pt->next = 1; 

} 

} /* end if second and third tests*/ 

} /* end if first test */ 



} 



/*★★★★*★*★*★★★★*★★★*★**★★★★★*★★★★*★*★★*★★★★*★*★★*****★***★*****★*★*** j 

/* main function */ 

/*★***★****★*********************************★*********************** y 

main ( ) 

{ 

PIXEL current [12], prev[12]; 
int UL,U,UR,L,R,DL,D,DR,c; 

/* reg_file = f open (" regions . txt " , "w" );* / 



for ( y = 1 ; y < ydim ; ++y) 

{ 

for (x=l; x < xdim ; ++x) 
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i = (y * xdim) + x; 
neighbor_included =0; 
min = PI ; 



UL=i+xdim-l; U = UL + 1 ; UR = U+l; 
L= i-1 ; R = i + 1; 

DL=i -xdim- 1 ; D=DL+1; DR = D+l; 

if ( x == xdim-1) 

{ 

for ( c=0 ; c<xdim-l; C++) 

{ 

prev[c]=current [c] ; 
current [c] . phi=0.0; 
current [c] . r = NULL 
current [c] . significant = 0; 

} 

} 



if((x ! = xdim-1) && (y != ydim-1)) 



/* calculate dx,dy via sobel operator for pixel i */ 
dx = -gl [UL] + gl [UR] 

-2 *gl [L] + 2*gl[R] 

-gl [DL] + gl [DR] ; 

dy = gl [UL] +2*gl [U] +gl [UR] 

-gl [DL] -2 *gl [D]-gl [DR] ; 

if ( (dx*dx) + (dy*dy) > threshold) 

{ 

orientation = atan2 ( dy , dx) ; 

current [x] . phi = orientation; 
current [x] . significant = 1; 

pixel_membership (current , prev,x,y, orientation) 

) 



} 

} 

/* f close (reg_file) ;*/ 

/* Check remaining REGIONS for lines: */ 

reg = f irst_region ; 

while (reg != NULL) 

{ 
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line_test (reg) ; 
reg = reg->next; 

} 

/* Write the lines list to file " lines . text " . */ 
wri te_all_lines (xdim, ydim) ; 

printf ( " \nLines found in image written to lines . text ' \n" 
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APPENDIX B - FINDEDGE ROUTINES 



l * FI LENAME : f indedge . c 

/* AUTHOR: Leonard V. Remias and Khaled Morsy 
/* some fragments from Peterson 

/* DATE: 18 January 1996 
/* 

/ ^DESCRIPTION: An image gradient program incorporating edge-f inding . 
/*Displays edge-gradient image and associated lines. 

/* 

/*This application is designed for use on a Silicon-/ ^Graphics Iris (r) 
/ ^workstation utilizing a . sgi or similar rgb formatted image. 

/ *RGB values are of type LONG in the form AABBGGRR where: 

/* AA - alpha value, 0-255 

/* BB - blue component, 0-255 

/* GG - green component, 0-255 

/* RR - red component, 0-255 

/* 

/ *SiliconGraphics graphics library functions used within the 
/* display_bw_and_gradient_images ( ) routine: 

/* qdevice ( ) , winset ( ) , c3f(), move2 ( ) , draw2 ( ) , 

/* swapbuf fers ( ) , reshapeviewport ( ) , winclose(), 

/* and lrectwrite ( ) . 

/* 

/ *NPSIMAGE function routines borrowed courtesy of M.Zyda: 

/ *read_sgi_rgbimage ( ) , get_empty_rgba_nps image ( ) , 

/ *get_empty_rgb_nps image ( ) , and rgbalong_to_bwlong ( ) . 

/* 

/*Least Squares Fit method for line-finding from 
/*"Sonar Data Interpretaion for Autonomous Mobile Robots" 

/*by Y.Kanayama, T. Noguchi, & B. Hartman, 1990. 



#include <gl.h> /* SiliconGraphics (r) graphic library */ 

#include <gl/image.h> /* SGI image structure library */ 

tinclude <device.h> /* Machine-dependent device library */ 

/* for keys and mouse-buttons */ 

#include <stdio.h> /* C standard i/o library */ 

#include <math.h> /* C math library for atan2 ( ) */ 



#include " image_types . h" /* Type definitions for NPSIMAGE, etc. */ 
#include " edge_ types . h" /* Type definitions for EDGE, LINE, etc */ 
#include "npsimagesupport . h" /* Some NPSIMAGE functions */ 
#include " edgesupport . h" /* EDGE and IMG_LINE building functions */ 
#include " displaysupport . h" /* Graphics display functions */ 
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int neighbor__included; 



main(argc, argv) 
int argc ; 
char *argv[] ; 

{ 

NPSIMAGE *imgl, /* input f i 1 e__name . r gb color image */ 

*img2, /* black&white image */ 

*img3; /* gradient image */ 

/* pointers to RGBA longs ( " bi tsptr " s ) of respective NPSIMAGEs */ 

long *ptrl, *ptr2 , *ptr3 ; 

double dx, dy, Th = THRESHOLD* THRESHOLD; 

int z = 0; /Counter for pixels in gradient image */ 

REGION *reg ; 

PIXEL cut rent [ 646 ], prev [ 646 ] ; 
double orientation; 
int UL,U,UR,L,R,DL,D,DR,c; 
int; 

long x, y; 

long ptr4 [313956] ; /*646 x 486 */ 

reg_file = f open ( " regions . txt " , "w" ) ; 

if (argc != 2) fatal ( "usage : findedge filename\n" ) ; 

/* Read in input rgb image */ 
imgl = read_sgi_rgbimage ( argv [ 1 ] ) ; 
if ( imgl == (NPSIMAGE *) NULL) 

{ 

fatal ("File %s is a NULL image . \n" , imgl- >name) ; 

} 

Xdim = imgl->xsize; /* else set global Xdim and ptrl */ 

Ydiro = imgl->ysize ; 

ptrl - imgl->imgdata . bitsptr ; 

/* print f (" findedge : > %s xsize= %d ysize= %d pixels= %d\n" , 

imgl->name / imgl->xsize, imgl->ysize, ( imgl->xsize* imgl- 

>ysize) ) ; * / 

/* Declare new NPSIMAGEs */ 

if ( ( imgl->type == RGB AWI THAL PHA ) || (imgl->type == RGBA)) 

{ 

img2 = get_empty_rgba_nps image (Xdim, imgl->ysize, imgl->name) ; 
img3 = get_empty_rgba_nps image ( (Xdim-2) , imgl->ysize-2 , "findedge") ; 

} 

else 

{ 

fatal ( "Unknown or c-mapped image type: %d . \n" , imgl->type) ; 

} 

ptr2 = img2->imgdata .bitsptr; 
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ptr3 = img3->imgdata . bitsptr ; 



/* The scan of an RGB image is from the bottom row -> up, 
traversing the rows left to right. */ 

/* In order for the Sobel operator to be calculated for a specific pixel, 
all eight surronding pixels must have an absolute (black & white) 
light intensity calculated. Function rgbalong_to_bwlong ( ) performs 
this task. */ 



/* Due to the nature of the Sobel operator, the pixels in the top and 
bottom rows as well as pixels in the leftmost and rightmost columns 
of the input image will not be calculated. In order to start cal- 
culating the Sobel operators, the first 2 rows of the input image 
must be converted to black & white light intensity values. */ 

/* Calculate bw values for the entire input image. */ 



for ( i=0 ; i< ( (Xdim * Ydim) -1 ) ; ++i ) 



{ 

} 



rgbalong_to_bwlong ( ptrl [ i] , &ptr2 [ i ] ) ; 
ptr4[i] = gray; 



for (y=0; y < Ydim; + +y) 

{ 

for (x=0; x < Xdim; + +x) 

{ 

i = (y * Xdim) + x; 
neighbor_included = 0; 
min = PI ; 



UL=i + (Xdim-1 ) ; U = UL+1 ; UR = U+l; 
L= i-1 ; R = i+1 ; 

DL=i- (Xdim-1) ; D=DL+1; DR = D+l; 



if (x == (Xdim-1 ) ) 

{ 

for (c=0; c< (Xdim-1); C++) 

{ 

prev [c ] =current [c] ; 
current [c] .phi=0.0; 
current [c] ,r = NULL; 
current [c] . significant = 0; 

} 



if ( (y == 0) || (y == (Ydim-l) ) || (x == 0) || (x == (Xdim-1 )) ) 

{ 

set jpixel_black (&ptr3 [i] ) ; 

} 
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else 

{ 

/* Calculate dx,dy via Sobel operator for pixel i. */ 

dx = - (ptr4 [i+ (Xdim-1) ] ) + (ptr4 [i+ (Xdim+1) ] ) 

- 2 *{ ptr4[i-l])+ 2 *{ptr4[i+l]) 

- (ptr4 [i-Xdim-1] ) + (ptr4 [i-Xdim+1 ] ) ; 
dy = {ptr4 [i+Xdim-1] ) + 2* (ptr4 [ i+Xdim] ) 

+ {ptr4 [i+Xdim+1] ) - (ptr4 [i-Xdim-1] ) 

- 2* (ptr4 [i-Xdim] ) - (ptr4 [i-Xdim+1 ]) ; 

if ( ( (dx*dx) + (dy*dy) ) > Th) 

{ 

orientation = atan2 (dy , dx) ; 
current [x] .phi = orientation; 
current [x] . significant = 1; 

pixel_member ship (current , prev, x , y , or ientation) 
set_pixel_black (&ptr3 [z] ) ; 

} 

else 

{ 

set_pixel__white (&ptr3 [ z] ) ; 

} 

+ + z ; 

} 

} /* endfor x */ 

} /* end for y */ 

fclose (reg_file) ; 

reg = f irst_region ; 

while (reg != NULL) 

{ 

reg->mlO , reg->m01 # reg->mll , reg->m20 , reg->m02 ) ; * / 
line_test (reg) ; 
reg = reg->next; 

} 



/* Write the lines list to file " lines . text " . */ 

wr ite_all_l ines (argv (1] , img3->xsize, img3->ysize) ; 

print f (" \nNumber lines found in %s = %d" # argv[l],Linecount); 

pr int f ( " \nNumber regions found in %s = %d\n" , argv [ 1 ] , reg_count ) ; 

/* Display the black&white and gradient images on the screen. */ 
display_bw_and_gradient__images { img2 , img3 , Line_l ist_head) ; 
display_l ine_image (img2 , Line_list_head) ; 

print f ( " \nf indedge %s . . . done . \n" , argv [1 ] ) ; 

} 



70 



/★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★it******************************** j 

/*file edge_types.h 
/* 

/*This file holds the structure definitions for edge extraction and linear 
/ * fitting routines . 

/ *Types defined : EDGE_REGION_TYPE 
/* PIXEL_INFO 

/* POINT_TYPE 

/* LINE_TYPE 

j 

struct point_type 

{ 

double x , y ; /* x,y coordinates of the pixel endpoints */ 

} ; 

typedef struct point_type POINT; 



typedef struct line_type 

{ 

char name [3]; /* for troubleshooting */ 

POINT pi, p2 ; /* the 2 endpoints for the line */ 
/* Least Squares Fit momments : */ 



double 


mOO ; 


/* 


Number of pixels should 


be long*/ 




double 


mlO ; 


/* 


Sum x * / 






double 


mOl ; 


/* 


Sum y */ 






double 


mil; 


/* 


Sum x*y */ 






double 


m2 0 ; 


/* 


Sum x*x */ 






double 


m02 ; 


/* 


Sum y*y */ 






double 


phi ; 


/* 


Calculated normal orientation of IMG 


;_line * 


double 


dma jor ; 


/* 


Length of major axis of 


equivallent 


ellipse 


double 


dminor ; 


/* 


Length of minor axis of 


equivallent 


ellipse 


double 


rho ; 


/* 


Ratio dminor/dmaj or */ 







/* Pattern Matching Information: */ 

double angle_to_image_center ; 

int *matchlist ; / * Bogus pointers for IMG_LINE *create_l ine ( EDGE *r,...) 

*/ 

/* in ‘ edgesupport . c ' . */ 

int *pm; /* These pointers are required for matching and are 

declared as (MATCHTYPE * ) s in ’ match__types . h ' 

*/ 

struct line_type *next; /* ptr to the next IMG_LINE in the image */ 

} IMG_LINE ; 
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typedef struct edge_region_type 

{ 

long first_pixel; 
long last_pixel ; 
double avg_phi; 
double sum_phi; 
double mOO ; 
double mlO ; 
double mOl ; 
double mil ; 
double m20 ; 
double m02; 

struct edge_region_type *next ; 
} REGION; 



typedef struct pixel_info 

{ 

double phi; 

REGION *r ; 

int significant; 

} PIXEL ; 



/* FILENAME: edgesupport . h 

/* AUTHOR: Leonard V. Remias and Khaled Morsy 
/* (some parts from original version by Peterson) 

/* DATE: 19 January 1996 
/* with new changes 

/ ^DESCRIPTION : Collection of edge finding functions. 

/* 

/* void fatal (char message) 

/* int gradient_angles__close (double r, double s) 

/* int close_to_negative_pi (double phi) 

/* int horizontal (EDGE *r) 

/* REGION *create_region ( int x, int y, double o) 

/* void add_pixel_to_edge (long z, double phi, EDGE *r) 

/* EDGE *combine_edges (EDGE *rl, EDGE *r2) 

/* IMG_LINE *create_line (REGION *r, double M20, double Mil, double M02, 
/* double Dmajor, double Dminor, double Rho) 

/* void line_test (REGION *r) 

/* void check_active_edges () 

/* void rgbalong_to_bwlong (long rgbalong, long *bwlong) 

/* void pixel_membership (long z, double phi) 

/* void set_pixel_white (long ^rgbalong) 

/* void set_pixel_black (long *rgbalong) 

/* void write_all_lines (long x, long y) 

/* IMG_LINE * f astlines (NPSIMAGE *img) 
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#def ine THRESHOLD 70.0 



/* Gradient Angular Orientation */ 

/*#define MAX__D E LT A_ PHI deg__to__rad ( 15 ) */ 

#def ine MAX_DELTA_PHI (PI*15/180) 

#define PI 3.14159265 

/* Constants for function: void line__test (REGION *r) */ 

#define MIN_PIXELS_PER_LINE 7 /* was 10 minimum pixels allowed for a 

IMG_LINE */ 

#define MIN_DMAJOR 7.0 /*was 10.0 * minimum major axis length 

allowed */ 

#define MAX_RHO 1.0 /* maximum ratio (Rho=Dminor /Dma j or ) */ 



/* Global variables 

*/ 

FILE *reg__f ile ; 
long Xdim; 
long Ydim; 
int Linecount = 0; 
int reg_count = 0; 
int gray ; 



/* width of input image (nr pixels) */ 

/* width of input image (nr pixels */ 

/* counter for number of IMG_LINEs made */ 
/* counter for number of regions */ 

/* added by khaled 1-8-95 */ 



/* Pointers to: first region , last region and IMG_LINE list*/ 

REGION *f irst_region=NULL; 

REGION * las t__region=NULL ; 

IMG_LINE * Lineal is t_head = NULL; 

int neighbor_included; 
double min; 



FUNCTION : deg_to_rad ( ) 

PURPOSE : convert degree to radian 



double deg_to_rad ( theta) 
double theta; 

{ 

return theta * PI/180; 

) 
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/★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★♦★★★★★★-a** 

FUNCTION : normalize () 

PURPOSE : return the normalized value of orientation 

★ ★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★•A-* j 

double normalize (o) 
double o; 

{ double h=o; 
int d = 0 ; 

if(o> = -PI ScSc o <PI) return ( o) ; 

d= ( o+PI ) / ( 2 *PI ) 
if (d> = 0 ScSc o > 0.0) 
d=d+l ; 

o = o - ( 2 *PI * (d-1 ) ) ; 

/* while(o < -PI) 

O = O + PI + PI ; 
while(o >= PI) 

o = o-PI-PI ; * / 

return (o) ; 

} 



void update (current ,x,y) 
PIXEL current [ ] ; 
long x # y; 

{ 

REGION *reg ; 
double o; 



o=current[x] .phi; 
reg=current [x] .r; 
reg-> last_pixel = (Xdim * y 



reg->sum_phi 


+ = o ; 


+ + reg->m00 ; 




reg->ml0 += 


x ; 


reg->m01 += 


y; 


reg->mll += 


x*y; 


reg->m20 += 


x*x ; 


reg- >m02 -f = 


y*y; 


reg->avg_phi 


= ( reg->sum_phi 



x) ; 



/ reg->m00) ; 
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/★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★•A-** j 

void comparel ( current , x , y ) 

PIXEL current [] ; 
long x,y; 

{ 

double t; 

REGION *current_region; 

t = fabs (normalize (current [x] .phi -current [x-1 ] .phi ) ) ; 

if ((t<= MAX_DELTA_PHI )&&( current [x- 1 ]. signi ficant == 1)) 

{ 



min = t ; 

current[x] .r = current [x-1] .r; 

/ *current [x] . region_number = current [x-1 ]. region_number ;*/ 
neighbor_included = 1; 

} 



^★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★** j 

void compare2 (current , prev,xl , x2 , y) 

PIXEL current [], prev [] ; 
long xl,x2,y; 

{ 

double t; 

REGION *current_region; 

t=f abs (normalize (current [xl ] .phi - prev [x2 ] .phi ) ) ; 

if ( (t<= MAX_DELTA_PHI ) && (prev [x2 ] . signi f icant == 1)) 

{ 

if (tcmin) 

{ 

min = t; 

current [xl] .r = prev[x2].r; 

/* current [xl ]. region_number = prev [x2 ] . region_number ;*/ 
neighbor_included = 1; 

} 

} 

} 
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/a ******************************************************************* i 

REGION *create_region(x, y, o) 

long x,y; 
double o; 

{ 

REGION *reg; 

if ( (reg= (REGION *) malloc ( sizeof ( REGION) )) ==NULL) 

{ 

print f (" create edge"); 

} 

++reg_count ; 

reg->f irst_pixel =(Xdim * y + x) ; if( reg->f irst_pixel < 0) 

print f ( "ERROR" ) ; 

reg->last_pixel = (Xdim * y + x) ; 

reg->avg_phi = o; 

reg->sum_phi = o; 

reg->m00 - 1.0; 

reg->ml0 = x; 

reg->m01 = y ; 

reg->mll = x*y; 

reg->m20 = x*x; 

reg->m02 - y*y; 

reg->next -- NULL; 

if ( f irst_region == NULL) 
first_region = reg; 
if {last_region != NULL) 

last_region->next = reg; 
last_region=reg; 

return (reg) ; 

} 

I -k j 

void pixel_membership ( current ,prev,x,y, o) 

PIXEL current [) ,prev[) ; 



long x,y; 
double o; 

{ 

REGION *reg; 

if (x > 1) 

{ 

comparel (current , x, y) ; 

if (y > 1) 

{ 
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} 



} 



compare2 (current , prev, x , x-1 , y ) ; 



} 

if (y > 1) 

{ 

compare2 ( current , prev, x, x, y) ; 
compare2 ( current , prev, x, x+1 , y ) ; 

} 



if (neighbor_included == 0) 

{ 

reg = create_region(x,y,o); 

fprintf (reg_f ile, " \n%d %d %u" , x, y, reg); 

current [x] .r = reg; 

} 

if (neighbor_included == 1) 

{ 

update ( current , x, y) ; 

} 



/* */ 

/* void fatal (char message) 

/* 

/* Prints error message and exits out of the program. 

/* */ 

fatal (message) 

char *message; 

{ 

fprintf (stderr, "Fatal ERROR: "); 

perror (message) ; 



exit ( -1 ) ; /* exit by failure */ 

} 

/* */ 

/* IMG_LINE *create_line (REGION *r, double M20, double Mil, double M02, 
/* double Dmajor, double Dminor, double Rho) 

/* 



/* Returns pointer to newly instantiated IMG_LINE with variables set 
/ * according to moments described by REGION r, secondary moments 
/* M20, Mil, and M02 , axis lengths Dmajor, Dminor, and ratio of 

/* axis lengths Rho. 

/* */ 

IMG__LINE *create_line ( r , M2 0 , Mil , MO 2 , Dmajor, Dminor, Rho) 

REGION *r; 

double M20 , Mil , M02 , Dmajor , Dminor, Rho; 

{ 

IMG_LINE *1; 
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long xl, yl , x2 , y2 ; 
double Phi, deltal, delta2; 
int negative_phi ; 

/* r-> f irst_pixel mapped onto the IMG_LINE will be endpoint pi 
r->last_pixel mapped onto the IMG_LINE will be endpoint p2 */ 



xl = r->f irst_pixel% (Xdim) , 
yl = r-> f irst_pixel / (Xdim) , 
x2 = r->last_pixel% (Xdim) , 
y2 = r->last_pixel/ (Xdim) ; 

/* Calculate the normal orientation of the IMG_LINE by atan2 ( ) function. 
*/ 



Phi = atan2 ( -2 *Mll , M02-M20 ) / 2 . 0 ; 

/* Deltal and delta2 are the offsets used to calculate the endpoints 
for the IMG_LINE segment based upon values xl,yl and x2 , y2 . */ 

deltal = (r->ml0/r->m00 - (double) xl )* f cos ( Phi ) + 

(r->m01/r->m00 - ( double )yl) *fsin(Phi) ; 
delta2 = ( r->ml0/r->m00 - (double) x2 ) *f cos (Phi ) + 

( r->m01/r->m00 - (double)y2) *fsin(Phi) ; 

/* Phi = atan2 ( -2 *M11 , M02-M20) /2 . 0 ) always returns positive result to 
Phi . 

Therefore, negative_phi = (r->avg_phi < 0.0) is necessary. */ 
negative_phi = (r->avg_phi < 0.0); 

/* Allocate memory for IMG_LINE 1. */ 

if ( ( 1 = (IMG_LINE * ) malloc ( sizeof ( IMG_LINE) ) ) == NULL) { 
fatal ( " create_line : mallocNn” ) ; 

} 

/* Calculate x,y coordinates for endpoints pi and p2 . */ 

l->pl.x = (double)xl + deltal * f cos ( Phi ) ; 

l->pl.y = (double)yl + deltal * f sin ( Phi ) ; 

l->p2.x = (double)x2 + delta2 * f cos ( Phi ) ; 

l->p2.y = (double)y2 + delta2 * f sin ( Phi ) ; 



/* Copy least squares fit moments. 



r / 



l->m00 


= r->m00; 


1 ->ml 0 


= r->ml0 ; 


l->m01 


= r->m01; 


l->mll 


- r->ml 1 ; 


1 ->m2 0 


= r->m20; 


l->m02 


= r->m02; 
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/* Phi is positive, but -pi < r->avg_phi < pi . */ 



if (negative_phi ) l->phi = -Phi; 
else l->phi - Phi ; 



/* Update rest of IMG_LINE values. */ 

l->next = NULL; 

l->dmajor = Dmajor; 

l->dminor = Dminor; 

l->rho = Rho; 

l->angle_to_image_center = 0.0; /* default values for LINE matching */ 
l->matchlist = NULL; 
l->pm = NULL; 

++Linecount; /* Increment global variable, Linecount. */ 

strcpy ( l->name , " "); 

sprint f ( 1 ->name , "%d" , Linecount); 



return ( 1 ) ; 

} 



/* Return IMG_LINE 1. */ 



/* */ 

/* void line_test (REGION *r) 

/* 

/* Determines if REGION r meets three requirements to be an IMG_LINE: 

/ * (1) The number of pixels in REGION r (r->m00) be greater than 

/ * MIN_PIXELS_PER_LINE . 

/* (2) The ratio (Rho) of the length of major and minor axes of the 

/* EDGE be less than MAX_RHO. 

/* (3) The length of the major axis (Dmajor) be greater than 

l* M I N_DMA J OR , the minimum IMG_LINE length allowed. 

/* If all three conditions are met, a new IMG_LINE type is created and 
/* appended to the Line_list in order of significance (in this case 
/* Dmajor) . 

/* */ 

line_test ( r ) 

REGION *r ; 

{ 

IMG_LINE *1, *insert_pt = Line_list_head ; 
double M20 , Mil , MO 2 ; 

double Ma, Mb, Mmajor , Mminor , Dmajor, Dminor, Rho; 



/**********★*★*****★***★************★***********★*******★************** j 

/* First test -- A IMG_LINE must have a required minimun number of pixels. 
*/ 

/★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★-A: j 



if (r->m00 > MIN_PIXELS_PER_LINE) 
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{ 



/* Calculate secondary moments by least squares fit.*/ 

M20 = r->m20 - ( (r->mlO *r->mlO ) /r->m00 ) ; 

Mil = r->mll - ( ( r->ml0*r->m01 ) /r->m00 ) ; 

M02 = r->m02 - ( ( r->m01 *r->m01 ) /r->m00 ) ; 

/* Calculate major and minor axis lengths, Dmajor and Dminor . * / 
Ma = (M20+M02) /2 . 0; 

Mb = sqrt ( ( (M02 -M2 0 ) * (M02-M2 0 ) /4 . 0 ) + (M11*M11) ); 

Mmajor = Ma - Mb; 

Mminor = Ma + Mb; 

Dmajor = 4 . 0 *sqrt (Mminor /r->m00 ) ; 

Dminor = 4 . 0 *sqrt (Mma j or /r->m00 ) ; 



/* Calculate ratio Rho.*/ 

Rho = Dminor /Dmajor ; 

/* Second & Third tests -- Ratio Rho must represent a line, not a blob. 

-- IMG_LINE must be at least a certain length. */ 



if ((Rho < MAX_RH0) && (Dmajor > MIN_DMAJOR) ) 

{ 

/* The REGION passed the three requirments to be a line.*/ 

1 = create_line (r , M20 , Mil , M02 , Dmajor , Dminor , Rho) ; 

/* Add new IMG_LINE to IMG_LINE list in order by IMG_LINE 
length, dmajor. */ 

if (Line_list_head == NULL) 

{ 

Line_list_head = 1; 

} 

else if(l->dmajor > Line_list_head->dma jor ) 

{ 

l->next = Line_list_head; 

Line_list_head = 1; 

} 

else 

{ 

while (( insert_pt->next != NULL) && 

(l->dmajor < insert_pt->next->dma j or ) ) 

{ 

insert_pt = insert_pt->next ; 

} 

l->next = insert_pt->next ; 
insert_pt->next = 1; 

} 
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} /* end if second and third tests*/ 

} /* end if first test*/ 

} 



/* */ 

/* void rgbalong_to_bwlong (long rgbalong, long *bwlong) 

/* 

/* Converts color to black/white for rgba formatted pixels. 

/* The weights assigned for each color are television standards. 

/* This function courtesy of M. Zyda . 

/* */ 



rgbalong_to_bwlong (rgbalong, bwlong) 

long rgbalong; /* input color rgbalong */ 
long *bwlong; /* output b/w rgbalong */ 



{ 

unsigned char red, green, blue, alpha; 
unsigned bw; 

/* Use bit masks to get RGB and alpha values from input rgbalong. */ 

red = rgbalong & OxOOOOOOff; 

green = (rgbalong & OxOOOOffOO) >> 8 ;* 

blue = (rgbalong & OxOOffOOOO) >> 16; 

alpha = (rgbalong & OxffOOOOOO) >> 24; 

/* if ( i = = 4000 || i = = 5000) pr int f ( " \n%d :alpha = %d" , i, alpha);*/ 
/* Calculate the black&white intesity using NTSC standard. 

intensity = 0.299(red) + 0.587(green) + 0.114(blue) */ 

bw = (0.299*red) + ( 0 . 587 *green) + ( 0 . 114*blue) ; 

/* Save the black&white intensity in bwlong. */ 

*bwlong = (alpha<<24) | (bw<<16) | (bw<<8) |bw; 

gray=bw; 



} 



/* V 

/* void set_pixel_white (long *rgbalong) 

/* 

/* Sets the specified long integer pointed to by rgbalong to be 
/* white by setting all RGB bits to ff (255 dec -> max intensity) . 
/* */ 



set_pixel_white ( rgbalong) 
long * rgba long; 

{ 
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*rgbalong = Oxffffffff; 

} 

/* */ 



/* void set_pixel_black (long * rgbalong) 

/* 

/* Sets the specified long integer pointed to by rgbalong to be 

/* black by setting all RGB bits to 00 (0 dec -> min intensity). 

/* */ 

set_pixel_black (rgbalong) 
long * rgbalong; 

{ 

*rgbalong = OxffOOOOOO; 

} 



/* */ 

/* void write_all_lines (long x, long y) 

/* 

/* Write to output file "name. text". 

/* */ 

write_all_l ines (x , y ) 

long x,y; /* the x,y dimensions of the image */ 

{ 

IMG_LINE *1 = Line_list_head; 

FILE *lines_f ile ; 

lines_file = fopen( H lines.text" / "w"); 

fprintf (lines_f ile, " DATA FOR EXTRACTED LINE SEGMENTS \n" ) ; 

fprintf (lines_file Image size: nr pixels x axis = %d, nr pixels y axis 
= %d\n " , x # y) ; 

fprintf ( lines_file Extracted line segments listed in order by 
length . \n\n" ) ; 

while (1!=NULL) 

{ 

fprintf ( lines_file, " %s> length = %.4f, thinness = %.4f, orientation 
- % . 4f , mOO = %d\n" , 

l->name, l-ximajor, l->rho / l->phi, l->m00); 

fprintf (lines_file, "endpoints : (%.2f %.2f) ( % . 2 f %.2f)\n\n", 

l->pl .x, l->pl .y, l->p2 .x, l->p2 . y) ; 

1 = l->next; 

} 

/* f close (lines_file) ; */ 

printf ( " \nLines found in image written to: ' lines . text '") ; 

} 



82 



APPENDIX C - IMAGE UNDERSTANDING ROUTINES 



The following routines provide implementation for the imageTest.c routine. 
The files included are the following: 

user .h, displayCtrl . h, displayCtrl . c , acquisitionCtrl . h, 
acquisitionCtrl . c , imsControl . h , imsControl . c , imagelog.h, imagelog.c. 
They are located in the ~yamabico/vision96 directory. 



/★★★**★★★*★*★★***★*★***★*********★★★**★+*★★**★★*★★★★★★**★★★★ j 

} 

FILENAME : imageTest . c 

DESCRIPTION: This file contains image test routines 

REVISION HISTORY: Leonard V. Remias and Khaled Morsy, Winter 96* 

some fragments from Kisor 



^★★★★★★★★★******************** 

To shorten the descriptions below several abbreviations are used: 
AM: Acquisition module 
DM: Display module 

AO : Frame AO 
Al : Frame Al 
Bl : Frame Bl 

Acq: acquisition (as in waitAcq, wai tAquisition) 

IMS Ref Man: Imaging Technology Inc's IMS (Standard Image Manager) 
reference Manual for series 150/40 

★ *★★★******★****■*•***★★****★* j 

#include "user .h" 

#include "displayCtrl .h" 

#include " acquisitionCtrl . h" 

#include " imsControl . h" 



/**** Local Prototypes *****/ 
int 

getChoice ( void) ; 

/* Gets the menu choice that is desired 
*/ 

void 

interlacePage2 (void) ; 

/* Copies the page 2 part of an interlaced image into between the lines 
** of page one of the interlaced image to make a truely interlaced picture 
*/ 



83 



void 

copylmageToMemory ( IMSPage frameNumber) ; 



void 

copylmageToFrame ( IMSPage frameNumber) ; 



int 

user() { /* lvr test program for grabbing/snapping an image */ 

BOOLEAN readyToExit = FALSE; /* The exit flag */ 



while ( ! readyToExit ) 

switch (getChoice ( ) ) { 

case 1: /* Start grabbing images */ 
set Input Path (Al , CAMERA) ; 
set Input Path ( Bl , CAMERA) ; 
setlnputPath (AO, CAMERA) ; 

puts ("Input paths set: Camera->A0, Camera->A1 and CAMERA->B1") 

setFrameAcquire ( AO , GRAB); 
setFrameAcquire ( Al , GRAB); 
setFrameAcquire (Bl , GRAB) ; 

puts ("Set up to grab images into frames AO, Al and Bl"); 

cycleThroughLEDs ( ) ; 
acqEnable ( ) ; 

puts ("Frame has been grabbed"); 
break; 

case 2: /* Stop grabbing images */ 
setlnputPath ( Al , CAMERA) ; 
setlnputPath (Bl , CAMERA) ; 
setlnputPath (AO , CAMERA); 

puts ("Input paths set: Camera->A0, Camera->Al and CAMERA->Bl") 

setFrameAcquire (AO , FREEZE); 
setFrameAcquire (Al , FREEZE) ; 
setFrameAcquire ( Bl , FREEZE); 

puts ("Stop grabbing images into frames AO, Al and Bl"); 
break; 

case 3: /*Snap an image */ 

setlnputPath (Al , CAMERA) ; 
setlnputPath ( Bl , CAMERA); 

setlnputPath (AO , CAMERA); 

puts ("Input paths set: Camera->A0, Camera->A1 and CAMERA->B1") 
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setFrameAcquire (AO , SNAP); 
setFrameAcquire (Al , SNAP); 

setFrameAcquire (Bl , SNAP) ; 

puts ("Set up to Snap an image into frames AO, Al and Bl"); 

cycleThroughLEDs ( ) ; 
acqEnable ( ) ; 

puts ("Frame has been snapped"); 
break ; 

case 4: /* Zeroize (clear) pixel data in all frames Bl */ 

set Input Path ( Al , CONSTANT); 
set Input Path (Bl , CONSTANT); 
setlnputPath (AO , CONSTANT); 

puts ("Input paths set: Cons tant->A0 , Constant->Al & Constant- 

>Bl " ) ; 



setFrameAcquire (AO , SNAP); 
setFrameAcquire (Al , SNAP) ; 
setFrameAcquire (Bl , SNAP); 

puts ("Set up to Snap an image into frames AO, Al and Bl"); 

cycleThroughLEDs ( ) ; 
acqEnable ( ) ; 

puts ("Frame has been snapped"); 
break; 

case 5: /* Zeroize (clear) 1 MByte frame page AO */ 
interlacePage2 ( ) ; 
break; 



case 6: /* Zeroize (clear) 1 MByte frame page AO */ 
setFirstKToConstant ( AO , 0x0000) ; 

break; 

case 7: /* Zeroize (clear) 1 MByte frame page Al */ 

setFirstKToConstant (Al , 0x0000) ; 
break; 

case 8: /* Zeroize (clear) 1 MByte frame page Bl */ 

setFirstKToConstant (Bl, 0x0000) ; 
break; 

case 9 : 

selectPage (A0 ) ; 
puts ("Frame A0 selected"); 
readyToExit = TRUE; 
break; 
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case 10: 

selectPage ( Al ) ; 
puts ("Frame Al selected"); 
readyToExit = TRUE; 
break; 

case 11: 

selectPage (B1 ) ; 
puts ("Frame B1 selected"); 
readyToExit = TRUE; 
break; 

case 12 : 

selectPage (AM) ; 

puts ( "Acquisition module selected"); 

readyToExit = TRUE; 

break; 

case 13 : 

selectPage (DM) ; 

puts ( "Display module selected"); 

readyToExit = TRUE; 

break; 

case 14: 

ImageLog (NULL, 0 ) ; 
copylmageToMemory (Bl ) ; 
readyToExit = TRUE; 
break; 

case 15: 

copylmageToFrame (Bl) ; 
break; 

default : 

puts (" Error :main - Illegal option selected"); 
rexit ( ) ; 

} 

} 



int 

getChoice (void) 

/* Gets the menu choice that is desired 
*/ ( 



puts ( " \n\nWhat would you like to see?"); 
printf("\n Enter 1 Start grabbing images.") 
printf("\n Enter 2 Stop grabbing images.") 
printf("\n Enter 3 Snapshot (snap an image) 



) 



printf(" \n Enter 4 Zeroize (clear) pixel data in all frames." 
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printf ( " \n Enter 5 Interlace the image.”); 

printf( M \n Enter 6 Zeroize (clear) 1 MByte frame page AO " ) ; 

printf ( "\n Enter 7 Zeroize (clear) 1 MByte frame page A1 " ) ; 

printf ("\n Enter 8 Zeroize (clear) 1 MByte frame page Bl"); 

printf ( " \n Enter 9 Exit with frame AO selected”); 

printf ( M \n Enter 10 Exit with frame A1 selected"); 

printf ( " \n Enter 11 Exit with frame B1 selected") ; 

printf ( " \n Enter 12 Exit with Acquisition Module registers selected" ) ; 
printf ("\n Enter 13 Exit with Display Module registers selected") ; 
printf (”\n Enter 14 Copy image from IMS frame B1 to Sparc Memory"); 
printf ("\n Enter 15 Copy image from Sparc memory to IMS frame B1 "); 

printf ("\n\n The choice is : " ) ; 

return ( Getlnt ( ) ); 



} 



void 

interlacePage2 (void) 

/* Copies the page 2 part of an interlaced image into between the lines 
** of page one of the interlaced image to make a truely interlaced picture 
*/ { 

int i , j; 

unsigned long pagellndex = OxfaOOOOOO; /* First empty line for pg2 pixels 
*/ 

unsigned long page2Index = 0xfa07a400; /* First IK of pixels on page 2*/ 

unsigned long pagelDestination = 0xfa000800; 
unsigned long page2Source = 0xfa07a400; 

selectPage (B1 ) ; 

for (i=0; i<236; i++) { 

printf ("The indexes are now %x and %x . \n" , pagellndex, page2 Index ) ; 

for (j=0; j<366; j++) { /* 732 bytes but 2 bytes per access */ 

* (WORD* ) pagelDestination = * (WORD* ) page2Source ; 
pagelDestination += 2; 
page2Source += 2; 

} 

pagellndex += 0x800; 
page2 Index += 0x800; 
pagelDestination = pagellndex; 
page2Source = page2Index; 



} 



) 
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YAMAIMAGE bl Image; 



BYTE image [476] [732] ; 
void 

copylmageToMemory ( IMSPage f rameNumber ) 

/* Put comments here 
*/ 

{ 

unsigned long pagellndex = OxfaOOOOOO; /* First empty line for pg2 pixels 
*/ 

unsigned long page2Index = 0xfa07a400; /* First IK of pixels on page 2*/ 
unsigned long pagelSource = OxfaOOOOOO; 
unsigned long page2Source = 0xfa07a400; 



int i , j ; 

int xSize = 732; 
int ySize = 476; 



bllmage . xSize = xSize; 
bl Image .ySize = ySize; 

printfC' IM IN copylmageToMemory functionin' 1 ); 

for(i=0; i<238; i+=2) 

{ 

for (j = 0; j < 3 6 6 ; j+=2) /*732 bytes but 2 bytes per access*/ 

{ 



bllmage. image [i] [j] = * (BYTE* ) pagelSource ; 
pagelSource += 2; 

bllmage . image [ i+1 ][ j ] = * ( BYTE* ) page2Source ; 
pagelSource += 2; 



} 

pagellndex += 0x800; 
page2Index += 0x800; 
pagelSource = pagellndex; 
page2Source = page2Index; 



} 



Loglmage (bllmage) ; 
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/★*****★★*** 

static int GetWheelEncoder (LONG HighWordAddress , LONG LowWordAddress ) 

{ 

LONG Wheel; 

Wheel = * (WORD* ) HighWordAddress ; 

Wheel = Wheel << 16; 

Wheel += * (WORD* ) LowWordAddress ; 



return Wheel; 

} 






void 

copylmageToFrame (IMSPage f rameNumber ) 

/* Put comments here 
*/ { 

unsigned long pagellndex = OxfaOOOOOO; /* First empty line for pg2 pixels 
*/ 

unsigned long page2Index = 0xfa07a400; /* First IK of pixels on page 2*/ 
unsigned long pagelSource = OxfaOOOOOO; 
unsigned long page2Source = 0xfa07a400; 

int errorAddress = 0; 

int i, j ; 



for(i=0; i<476; i++ ) { 

for ( j = 0 ; j < 7 3 2 ; j++) { /*732 bytes but 2 bytes per access */ 

* (BYTE* ) pagelSource = bl Image . image [ i ] [j]; 
pagelSource++ ; 



} 



} 

if 



} 

pagellndex += 0x400; 
pagelSource = pagellndex; 

(errorAddress) 

print f ( "There are differences in the frame and spare memory! \n" ) ; 
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/************************************************************★********* j 

/*file user.h 

/*This files includes the various files for integrating the image routines 
with MML and for setting up the system to upload/download image data 



★★★★★★★★★★★★ 



/ 

#include 
#include 
# include 
#include 
#include 
#include 
#include 
# include 
# include 
#include 
# include 






cmath . h> 

" de f ini t i ons . h * 
"stdiosys - h" 
"serial . h" 

" trace . h" 
"geometry . h" 
"time . h" 
"seqcmd. h" 
"system.h" 
"memsys . h" 

" i maaol nn "h " 



FILENAME: displayCtrl . h 

DESCRIPTION: This file contains prototypes for the low 

level image routines that manipulate the 
display module registers. 

REVISION HISTORY: jck: LT John Kisor USN Winter 95’ 

jck 950110 

★ ★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★■A-****-** j 

f-k-k-k tes ****** 

940112 Find out how much of Sparc's memory is currently used. 

★★★★★★★★★★★★★★★ i 



typedef enum 



{ NI800by600, 
Nl640by480 / 
NI1024by768 / 
RS17 0 , 

CCIR, 
RS170SQ, 
CCIRSQ1 , 
CCIRSQ2 , 
OneKbyOneK 
} MONITORS; 



/* 800x600 non-interlaced */ 

/* 640x480 non-interlaced */ 

/* 1024x768 non-interlaced */ 

/* RS170 512x480 interlaced */ 

/* CCIR 512x512 interlaced */ 

/* RSl70sq 640x480 interlaced */ 

/* CCIRsq 768x512 interlaced */ 

/* CCIRsq 768x574 interlaced */ 

/* 1024x1024 interlaced */ 



void 

ini tDisplay (MONITORS monitorType) ? 

/* Configure the display module to display images on the 
** selected monitor. See DM reference manual 
*/ 



void 

resetDMCtrl (void) ; 

/* resets the communication between the host and the GSP 



90 



/ 



void 

initGSP (void) ; 

/* write causes the GSP to enter a reset state. Reading causes the GSP to 
** exit the reset state See sect 3.1.5 of the DM Ref Man 
** Show Mike this! ! ! 

*/ 

int 

checkDMId ( void) ; 

/* checks that the correct version of the display module is present. 

** See sect 3.1.6 of the DM Ref Man 
*/ 



void 

selectMonitor (MONITORS monitorType) ; 

/* Initializes the display modules GSP for the monitor specified 
** See sect 3.2.3 of the DM Ref Man 
*/ 



void 

writeDACLUT ( void) ; 

/* Writes a one to one coorespondence LUT for the output of RGB values 
** An input of 0 sets R:0 G:0 & B:0, an input of 1 sets R : 1 , G:1 & B:1 
etc . . . 

**See sect 3.3.2, 3.3.3 and 3.3.4 of the DM Ref man. 

*/ 



void 

writeOverlay { void) ; 

/* Sets al overlay color mappings to zero (clear) 

** No overlays will be shown only the image. 

**See sect 3.3.6, 3.3.7 and 3.3.8 of the DM Ref man. 
*/ 



FILENAME: di splayCtrl . c 

DESCRIPTION: This file contains the code to produce output from the 

the ITI display module 

REVISION HISTORY: jck: LT John Kisor USN Winter 95' 

jck 950110 

★ ★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★■it**** i 



91 



jck 950111 

To shorten the descriptions below several abbreviations are used: 

AM: Acquisition module 
DM: Display module 

AO : Frame AO 
Al : Frame A1 
B1 : Frame B1 

Acq: acquisition (as in waitAcq, wai tAquisition) 

IMS Ref Man: Imaging Technology Inc's IMS (Standard Image Manager) 
reference Manual for series 150/40 

DM Ref Man: Imaging Technology INc's DM-PC Hardware Reference Manual 



#include 


"definitions .h" 


#include 


" system . h" 


#include 


" stdiosys . h" 


#include 


" imsControl .h" 


#include 


"displayCtrl . h" 


/* Local 


prototypes */ 



void setGSPAddress (WORD MSBof GSPAddress , WORD LSBof GSPAddress ) ; 

/* Sets up the address of that GSP that will either be written or read 
** See sect 3.1 of the DM Ref Man 
*/ 

void 

writeToGSP (WORD gspData) ; 

/* Writes some data to a GSP address 

** See section 3.1.1, 3.1.2 and 3.1.3 of DM Ref man 

*/ 

WORD 

readFromGSP (void) ; 

/* Reads some data from a GSP address 

** See section 3.1.1, 3.1.2 and 3.1.3 of DM Ref man 

V 

WORD 

getGSPAddress (void) ; 

/* Test routine to see what values are being set into the DACLUT 
** write address 
*/ 
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void 

zeroizeGSPMemory ( void) ; 

/* Zeroizes the program and overlay memory in the GSP 
** See sect 3.2.1 and 3.2.2 in the DM Ref Man. 

*/ 

void 

initDisplay (MONITORS monitorType) 

/* Configure the display module to display images on the 
** selected monitor. See DM reference manual 
*/ { 

cycleThroughLEDs ( ) ; 

selectPage ( DM) ; /* Select the display module */ 

puts ( "Display Module Registers Selected"); 

if (checkDMId( ) ) 

puts ( "Correct DM present") ; 
else 

puts ( "ERROR-- incorrect DM present" ) ; 
resetDMCtrl ( ) ; 

puts ( "Communication between the host and GSP reset"); 
initGSP ( ) ; 

puts ("Resets the GSP state"); 

cycleThroughLEDs ( ) ; 
selectMonitor ( monitorType ); 

writeDACLUT ( ) ; 

puts ( "Writing to the DACs LUT"); 
writeOverlay ( ) ; 

puts ( "Writing zeros to overlay"); 



} 



void 

resetDMCtrl (void) 

/* resets the communication between the host and the GSP 
*/ { 

const dmCtrlReg = OxfaOOOOOG; 
const zero = 0x0000; 

* (WORD* ) dmCtrlReg = zero; 

} 
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void 

initGSP ( void) 

/* write causes the GSP to enter a reset state. Reading causes the GSP to 
** exit the reset state See sect 3.1.5 of the DM Ref Man 
** Show Mike this! ! ! 

*/ ( 

const displayControl = 0xfa000006; 
const GSPResetReg = 0xfa000008; 

const resetZero = 0x0000; 

const setlncrements = 0x0000; /* NO increment after write */ 

const cacheFlush = 0x4000; /* flush the old program from the cache */ 

WORD contents; 

* (WORD* ) displayControl = ( setlncrements | cacheFlush ); 

* (WORD* ) GSPResetReg = resetZero; 
contents = * (WORD* ) GSPResetReg ; 

zeroizeGSPMemory ( ) ; 



} 



int 

checkDMId (void) 

/* checks that the correct version of the display module is present. 
** See sect 3.1.6 of the DM Ref Man 
*/ { 

const modVersion = OxfaOOOOOc; 
const correctVersion = OxfffS; 
int status; 



if ( * (WORD* ) modVersion & correctVersion) { 

puts ( "Correct display module installed for cohu4110" ); 
status = 1; 

} 

else { 

puts ("Error - checkDMId (): Incorrect display module installed" ) ; 
printf("%d does not equal %d\n", * (WORD* ) modVersion , 

correctVersion ) ; 

status =0; 
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} 



return status; 

} 



void 

selectMonitor (MONITORS moni torType ) 

/* Initializes the display modules GSP for the monitor specified 
** See sect 3.2.3 of the DM Ref Man 
*/ ( 

const lowAddrReg = OxfaOOOOOO; 
const highAddrReg = 0xfa000002; 
const dataPortReg = 0xfa000004; 

WORD offset [ 12 ] = {0x0080, OxOObO, 0x0090, 0x0000, 

0x0010, 0x0020, 0x0030, 0x0040, 0x0050, 0x0060, 0x0070, 0x0000}; 



int i; 



WORD monitorlnf o [ 1 ] [12] = { 

{OxfOlO, OxOOcc, OxcOOc, /* 800x600 non-interlaced */ 

0x0005, 0x0017, 0x007d, 0x0085, OxOOOe, 0x0014, 0x026d, 0x0270, 
0x0007} } ; 

/***★**★★ 

{OxfOlO, OxOOcc, OxcOOc, /* 640x480 non-interlaced 

0x0005, 0x0012, 0x0064, 0x006a, OxOOOe, 0x0015, 0x01f6, 0x01f9, 0x002d) 



{OxfOlO, 
0x0005, 
0x000b} } ; 


OxOOcc , 
OxOOle , 


OxcOOc , 
OxOOaO , 


/* 1024x768 non- 
0x00a7, 0x0000, 


-interlaced 
0x0014, 0x0315, 


0x0318, 


{0x9020, 
0x0005, 
0x0247} , 


OxOOcc , 
0x0005, 


OxcOOc, 

0x0047, 


/* RS170 
0x004f , 0x0003, 


0x0011, 


0x0102 , 


0x0106, 


{0x9020, 
0x0009, 
0x0a47 } , 


OxOOcc , 
0x0006, 


OxcOOc, 

0x0048, 


/* CCIR 

0x0055, 0x0001, 


0x0014, 


0x0115, 


0x0153 , 


{0x9020, 
0x0014, 
0x064d} , 


OxOOcc , 
0x0008, 


OxcOOc , 
0x005a, 


/* RS170sq 
0x006f , 0x0003, 


0x0012, 


0x0103, 


0x0260, 


{0x9020, 


OxOOcc , 


OxcOOc , 


/* CCIRsql NO value given for [11] ! ! ! ! ! 



0x0009, OxOOOd, 0x006f, 0x007b, 0x0001, 0x0013, 0x0134, 0x014c, 0xe5c) , 
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{0x9020, OxOOcc, OxcOOc, /* CCIRsq2 
0x0009, OxOOOd, 0x006f, 0x007b, 0x0001, 0x0013, 0x0134, 0x014c, 
0x0e5c } , 



{ 0xb020 , OxOOcc, OxcOOc, /* 1024x1024 
OxOOOd, OxOOld, 0x009f, 0x00a9, 0x0007, 0x0024, 0x0225, 0x022b, 
0x010b} } ; 

****** j 

printf ( "Monitor 0 (1024x768) values are:\n ("); 
for (i=0; i<12; i + +) 

printf ( " %x, ", monitor Info [ 0] [ i ] ) ; 

printf ( ” ) \n" ) ; 



for(i=0; i<ll; i + +){ 

* (WORD* ) lowAddr Reg = offset[i]; /* offset in GSP address 

space * / 

* (WORD* ) highAddrReg = OxcOOO; /* high order word for GSP internal 

Reg* / 

* (WORD* ) dataPortReg = monitorlnf o [ 0 ][ im- 
print f ( "Writing to:%x%x the value: %x\n" , * (WORD* ) highAddrReg , 

* (WORD* ) lowAddr Reg, 

* (WORD* ) dataPortReg) ; 

} 



* (WORD* ) lowAddrReg = 0x0000; /*0ffset for control register, in GSP 
space*/ 

* (WORD* ) highAddrReg = 0x0100; /* high order word for "local" 

registers */ 

* (WORD* ) dataPortReg = monitor Inf o [ 0] [ 11 ] ; 

pr intf ( " Writ ing to:%x%x the value : %x\n" , * (WORD* ) highAddrReg , 

* (WORD* ) lowAddrReg, 

* (WORD* ) dataPortReg) ; 

} 



void setGSPAddress (WORD MSBofGSPAddress , WORD LSBof GSPAddress ) 

/* Sets up the address of that GSP that will either be written or read 
** See sect 3.1 of the DM Ref Man 
*/ { 

const lowAddrReg = OxfaOOOOOO; 
const highAddrReg = 0xfa000002; 

* (WORD* ) lowAddrReg = LSBofGSPAddress ; 

* (WORD* ) highAddrReg = MSBofGSPAddress; 
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void 

writeToGSP (WORD gspData) 

/* Writes some data to a GSP address 

** See section 3.1.1, 3.1.2 and 3.1.3 of DM Ref man 
*/ { 

const dataPortReg = 0xfa000004; 

* (WORD* ) dataPortReg = gspData; 



} 



WORD 

readFromGSP (void) 

/* Reads some data from a GSP address 
** See section 3.1.1, 3.1.2 and 3.1.3 of DM Ref man 
*/ ( 

const dataPortReg = 0xfa000004; 

WORD gspData; 

gspData = * (WORD* ) dataPortReg ; 
return gspData; 

} 



WORD 

getGSPAddress (void) 

/* Test routine to see what values are being set into the DACLUT 
** write address 
*/ { 

setGSPAddress ( 0x0100 , 0x0080); 
return { readFromGSP ( ) ) ; 

} 



void 

writeDACLUT (void) 

/* Writes a one to one coorespondence LUT for the output of RGB values 
** An input of 0 sets R:0 G:0 & B:0, an input of 1 sets R:l, G:1 & B:1 
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etc . . . 

**See sect 3.3.2, 3.3.3 and 3.3.4 of the DM Ref man. 

*/ { 

WORD i, z ; 

WORD LUTValue ; 

setGSPAddress (0x0100 , OxOOaO); /* Address of mask register */ 
writeToGSP ( Oxf f f f ) ; /* Set to NO masking in DAC */ 



setGSPAddress (0x0100, 0x0080); /* GSP DAC LUT write address - 2 */ 

writeToGSP (OxOOff) ; 

setGSPAddress ( 0x0100 , 0x0090 ) ; 

/ * readFromGSP ( ) ; /* Read RED value */ 

/* readFromGSP ( ) ; /* Read GREEN value, now LUT has pre-read next RGB */ 

for(i=0; i<256; i + +) /* For each pixel grayscale value */ 

for(z=0; z<3; z++){ /* for the red, green and blue DACs */ 

writeToGSP ( i ) ; 

/* Address is self incrementing after 3 writes (RG and B DACs)*/ 

} 



/********* Debugging code from here down, remove later jck ****/ 

/* This code prints out the values that are stored in the DAC LUT */ 

setGSPAddress ( 0x0100 , OxOObO); 
writeToGSP ( OxOOff ) ; 

setGSPAddress ( 0x0100 , 0x0090); 

print f ( "TESTING: Values of GSP DAC LUT are \n" ); 

for(i=0; i<256; i++) 

for(z=0; z<3; z++) { 

LUTValue = ( readFromGSP ( ) & OxOOff); 
print f (”%d, ", LUTValue) ; 

} 

printf ( " \nEnd of LUT values\n") ; 

/★★-A-************************** j 
} 



void 

zeroizeGSPMemory (void) 
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/* Zeroizes the program and overlay memory in the GSP 
** See sect 3.2.1 and 3.2.2 in the DM Ref Man. 

*/ ( 

const displayControl = 0xfa000006; 

const incrementOnRW = 0x1800; /* Auto increment on reads and writes 

*/ 

const noIncrementOnRW = 0xe7ff; 

WORD oldDisplayControl; 

WORD i , j , z ; 



oldDisplayControl = * (WORD* ) displayControl ; /* 

*/ 

* {WORD* ) displayControl = ( oldDisplayControl | 



turn on auto increment 
incrementOnRW ) ; 



printf ( " Zeroizing GSP program and overlay memory"); 
setGSPAddress { 0x3800 , 0x0000); 



for(z=0; z<8 ; z++) { 
printf 

for(i=0; i<1024; i++) 
for(j=0; j<1024; j++) 
writeToGSP { 0x0000) ; 

) 

printf { 11 \n" ) ; 



/* from 38 , 00000 to 3f,fffff 



r / 



/* 1 meg (1024 IKs) */ 

/*3800000 -> 3bfffff is program memory*/ 
/*3c00000 -> 3cfffff is overlay memory */ 



oldDisplayControl = * {WORD* ) displayControl ; /* turn off auto increment 

*/ 

* {WORD* ) displayControl = ( oldDisplayControl & noIncrementOnRW ); 



} 



void 

writeOver lay (void) 

/* Sets al overlay color mappings to zero (clear) 

** No overlays will be shown only the image. 

**See sect 3.3.6, 3.3.7 and 3.3.8 of the DM Ref man. 

*/ { 

WORD i, z ; 

WORD OverlayValue ; 

setGSPAddress (0x0100 , OxOObf ) ; /* GSP DAC overlay write address */ 

writeToGSP ( OxOOff) ; /* Start at zero minus one */ 
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setGSPAddress (0x0100, OxOOdO) ; /* GSP DAC overlay data address */ 

readFromGSP ( ) ; /* Read RED value */ 

readFromGSP ( ) ; /* Read GREEN value, now LUT has pre-read next RGB */ 

for(i=0; i<256; i++) /* For each pixel grayscale value */ 

for ( z=0 ; z<3; z + + ){ /* for the red, green and blue DACs */ 

writeToGSP (0x0000) ; 

/* Address is self incrementing after 3 writes (RG and B DACs)*/ 

) 



/********* Debugging code from here down, remove later jck ****/ 

/* This code prints out the values that are stored in the DAC LUT */ 

setGSPAddress (0x0100, OxOOfO) ; 
writeToGSP (OxOOff) ; 

setGSPAddress (0x0100, OxOOdO) ; 

print f ( ” TESTING : Values of GSP DAC Overlay are \n") ; 

£or(i=0; i<256; i++) 
for ( z=0 ; z<3 ; z + +) { 

OverlayValue = (readFromGSP ( ) & OxOOff); 
printf("%d, " , OverlayValue) ; 

} 

printf ( " \nEnd of Overlay values\n" ) ; 



FILENAME: acqTest.h 

DESCRIPTION: This file contains prototypes for the low 

level routines for the setting up the acquisition module 
REVISION HISTORY: jck: LT John Kisor USN Winter 95' 

jck 950110 

★ ★★★★★★★★★★★★★★★★★★★★★★★★•A-********************************** j 



int checkAMVer (void) ; 

/* Checks for the correct acquistion module version (i.e. 8 bit RS422) 
** See Section 3.2 in the AM Ref Man 
*/ 



void 

initAcqModule (void) ; 

/* Initializes the aquisition module 
*/ 



void 
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setCameraClockCtrl (void) ; 

/* Sets the camera output clock frequency to the CCLK pins on the camera 
** See Sect 3.3 in the AM Ref Man. 

*/ 



void 

setCameraTimingCtrl ( void) ; 

/* Sets up the timing interface to the camera 
** See 3.4 of the AM Ref Man 
*/ 



void 

setExtSyncCtrl (void) ; 

/* sets the EXSYNC frequency, length and polarity 
** See sect 3.5 in AM Ref man 
*/ 



void 

setSyncTime { void) ; 

/* sets the duration of the EXSYNC pulse output 
** Ser Sect 3.6 in AM Ref Man 
*/ 



void 

setLutCtr 1 ( void) ; 

/* sets the page size and output data path 
** See sect 3.7 of AM Ref Man 
*/ 



void 

setHorizOff set (void) ; 

/* Sets the location of the first valid pixel of each line relative 
** to the selected edge of the LEN input 
*/ 



void 

setHorizActive ( void) ; 

/* sets the number of valid pixels in each line. When horizontal offset 
** reaches zero the AM enables the horizontal counter and tarts loading 
** the line FIFOs. See sect 3.10 in AM Ref Man 
*/ 



void 

setVertOff set (void) ; 
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/* Sets the location of the first valid line of each frame relative to the 
** selected edge of FEN input. When the AM offset counter reaches zero, the 
** AM signals the mother board that the first line is ready. 

** See sect 3.11 in the AM Ref Man 
*/ 



void 

setVertActive ( void) ; 

/* Sets the number of valid lines in each frame. When the vertical offset 
** counter reaches zero, the AM starts unloading lines from the FIFO to the 
** mother board. See sect 3.12 AM Ref Man 
*/ 



void 

initAMTrigger (void) ; 

/* initializes the AM trigger register. See sect 3.13 in AM Ref Man 
*/ 



int 

enableAMTrigger ( void) ; 

/* Enables the AM trigger mode. This bit is cleared when a trigger occurs. 
** It cannot be set while a trigger cycle is in progress. 

** See sect 3.13.1 in AM Ref Man 
*/ 



int 

enableSof tTrigger ( void) ; 

/* Enables the use of a software trigger as opposed to a trigger from the 
** camera. See Sect 3.13 in AM Ref man. 

*/ 



void sof tTrigger (void) ; 

/* Causes an external trigger pulse to the AM, if the software trigger is 
** enabled. See sect 3.15 in AM Ref Man. 

*/ 



/★★★•A-******************************************************* 

FILENAME: acquis it ionCtrl . c 

DESCRIPTION: This file contains the image code for the acquistion 

module 

REVISION HISTORY: jck: LT John Kisor USN Winter 95' 

jck 9501101 

**★**★*****★★**★★**★**★*★**★*★*★****★**★*★★*★*★****★*★**★***/ 
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FAX941028 refers to a fax received from ITI regarding the acquistion 
registers . 

Most of the values for these routines were obtained from that fax. 

**************************** i 
I***************************** 

jck 950111 

To shorten the descriptions below several abbreviations are used: 

AM: Acquisition module 
DM: Display module 

AO : Frame AO 
Al : Frame Al 
B1 : Frame Bl 

Acq: acquisition (as in waitAcq, wai tAquisi tion) 

IMS Ref Man: Imaging Technology Inc's IMS (Standard Image Manager) 

reference Manual for series 150/40 

AM Ref Man: Imaging Technology Inc's AM-DIG Hardware reference manual 

**************************** j 

#include " definitions . h " 

# include " system. h" 

#include " stdiosys . h" 

#include " acquisitionCtrl .h" 

#include " imsControl . h" 



void 

initAcqModule (void) 

/* Initializes the aquisition module 
*/ { 

selectPage ( AM) ; /* Select the acquistion module */ 

puts ( "Acquisition Module Registers Selected"); 

i f ( checkAMVer ( ) ) 

puts ( "Correct AM present") ; 
else 

puts (" ERROR-- incorrect AM present"); 

setCameraClockCtrl ( ) ; 
setCameraTimingCtrl ( ) ; 
setExtSyncCtr 1 ( ) ; 
setSyncTime ( ) ; 
setLutCtrl ( ) ; 
setHorizOf f set ( ) ; 
setHorizActive ( ) ; 
setVertOf f set ( ) ; 
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setVertActive { ) ; 
initAMTr igger ( ) ; 

/**** Want trigger to come from camera ******** 
enableAMTrigger ( ) ; 
enableSof tTrigger ( ) ; 
sof tTrigger ( ) ; 

★★★★★★★★★★ j 

} 



int checkAMVer { void) 

/* Checks for the correct acquistion module version (i.e. 8 bit RS422) 
** See Section 3.2 in the AM Ref Man 
*/ { 

const modVersion = 0xfa000002; 
const correctVersion = 0xff03; 
int status; 

if ( * {WORD* )modVersion & correctVersion) { 

puts ( " Correct acquistion module installed for cohu4110"); 
status = 1; 

} 

else { 

puts ("Error - checkModuleVer (): Incorrect acquistion module 
installed" ) ; 

printf("%d does not equal %d\n" , * (WORD* ) modVersion, 

correctVersion) ; 

status =0; 

} 

return status; 



void 

setCameraClockCtrl (void) 

/* Sets the camera output clock frequency to the CCLK pins on the camera 
** See Sect 3.3 in the AM Ref Man. 

*/ ( 

const cohuClockCtrl = 0xfa000004; 
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const clockFreq 
*/ 

const clockDivisor 
const xillixMode 
const modeCtrl 



0x0000; /* set internal clock frequency to 14.32 MHz 

0x0000; /* Divide that clock frequency by one */ 
0x0000; /* not a Xillix camera */ 

OxOeOO; /* Mode control bits SeeFAX94102 8* / 



* (WORD* ) cohuClockCtrl = (clockFreq 

clockDivisor | 
xillixMode 
modeCtrl ) ; 



} 



void 

setCameraTimingCtrl (void) 

/* Sets up the timing interface to the camera 
** See 3.4 of the AM Ref Man 
*/ { 

const cohuTimeCtrl = 0xfa000006; 

const pixelClkPol = 0x0001; /* Sample data on falling edge of PCLK */ 

const lineEnablePol = 0x0002; /* Falling edge of LEN enables horiz 

timing* / 

const f rameEnablePol = 0x0000; /* Falling edge of FEN enables vertical 
timing* / 

/*jck! ! ! There is a conflict here. The fax token is " FEN_NoInvert " this 
implies the rising edge of FEN will enable vertical timing, but the 
cooresponding comment reads :/ /Falling Edge of FEN enables Vertical 
Timing . 

See sections 2. 2. 1.2 and section 3.4.3 in AM Ref Man. */ 
const f ieldPolari ty = 0x0000; /* Field input lwo defines even field */ 

const scanMode = 0x0000; /* Area scan mode */ 

const interlaceMode = 0x0020; /* Interlaced camera */ 

const LENSmall = 0x0000; /* Normal, LEN inactive period is greater */ 

/* than one PCLK cycle jck???*/ 

const NoLineMiss = 0x0000; /* Two lines inserted between line scan 

frames* / 

const lineVariable = 0x0200; /* Reset FIFO every FEN */ 

* (WORD* ) cohuTimeCtrl = (pixelClkPol | 

lineEnablePol j 
f rameEnablePol | 
f ieldPolari ty | 
scanMode 
interlaceMode | 

LENSmall 
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NoLineMiss 
lineVariable ) ; 



} 



void 

setExtSyncCtrl (void) 

/* sets the EXSYNC frequency, length and polarity 
** See sect 3.5 in AM Ref man 
*/ { 

const cohuSyncCntrl = 0xfa000008; 

const syncFreq = 0x0005; /* ext elk frequency: 14 . 32/2048=7Khz 
( 143usec ) */ 

const Sj’ncMode = 0x0000; /* ExSync triggers itself jck??? poss 0x0010*/ 

const sync Ena tie = 0x0000; /* EXSYNC counter disabled */ 

const syncPol = 0x0040; /* EXSYNC high when triggered,....*/ 

const intEnable = 0x0000; /* programmable integration disabled jck??? */ 

const intPulsePol = 0x0100; /* PRI disabled - output always low */ 

* (WORD* ) cohuSyncCntrl = (syncFreq 

syncMode 
syncEnable | 
syncPol 
intEnable 
intPulsePol ) ; 

} 



void 

setSyncTime (void) 

/* sets the duration of the EXSYNC pulse output 
** Ser Sect 3.6 in AM Ref Man 
*/ { 

const cohuSyncTime = OxfaOOOOOa; 
const hz2046 = 0x07fb; 

* (WORD* ) cohuSyncTime = hz2046; 



} 



void 

setLutCtrl (void) 

/* sets the page size and output data path 
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** See sect 3.7 of AM Ref Man 
*/ { 

const cohuLutCtrl = OxfaOOOOOc; 

const pixelSize = 0x0000; 
const muxSetting = 0x0000; 

* (WORD* ) cohuLutCtrl = (pixelSize | muxSetting); 



} 



void 

setHorizOf f set (void) 

/* Sets the location of the first valid pixel of each line relative 
** to the selected edge of the LEN input 
*/ ( 

const horizOffset = OxfaOOOOlO; 
const cohuOffset = 0x009a; 

* (WORD* ) horizOffset = cohuOffset; 



) 



void 

setHorizActive (void) 

/* sets the number of valid pixels in each line. When horizontal offset 
** reaches zero the AM enables the horizontal counter and tarts loading 
** the line FIFOs. See sect 3.10 in AM Ref Man 
*/ ( 

const horizActive = 0xfa000012; 
const cohuHorizActive = 0x02d8; 

* (WORD* ) horizActive = cohuHorizActive; 



) 



void 

setVertOf f set (void) 

/* Sets the location of the first valid line of each frame relative to the 
** selected edge of FEN input. When the AM offset counter reaches zero, the 
** AM signals the mother board that the first line is ready. 

** See sect 3.11 in the AM Ref Man 
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*/ { 

const vertOffset = 0xfa000014; 
const cohuVertOf f set = 0x0001; 



* (WORD* ) vertOf f set = cohuVertOf f set ; 

} 



void 

setVertActive (void) 

/* Sets the number of valid lines in each frame. When the vertical offset 
** counter reaches zero, the AM starts unloading lines from the FIFO to the 
** mother beard. See sect 3 ,12 AM Ref Man 
*/ { 

const vertActive = 0xfa000016; 
const cohuVer tActive = OxOldc; 

* (WORD* ) vertActive = cohuVertActive; 

} 



void 

initAMTrigger (void) 

/* initializes the AM trigger register. See sect 3.13 in AM Ref Man 
*/ { 

const triggerCtrl = 0xfa000018; 

const disableTrigger = 0x0000 ;/* trigger enabled*/ 

const triggerSource = 0x0000 ;/ *External trigger from camera connector, 

trigger on falling edge */ 

* (WORD* ) triggerCtrl =( disableTrigger | triggerSource); 



} 



int 

enableAMTrigger (void) 

/* Enables the AM trigger mode. This bit is cleared when a trigger occurs. 
** It cannot be set while a trigger cycle is in progress. 

** See sect 3.13.1 in AM Ref Man 
*/ { 
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const triggerCtrl = 0xfa000018; 



const enableTrigger = 0x0001; /* Trigger enabled */ 

const triggerNotActive = 0x0004; /*read-o, l:No ext. trigger cycle in 
progress * l 

int status; 

if ( ( * (WORD* ) triggerCtrl & triggerNotActive )){/* trigger not in 

progress * / 

* (WORD* ) triggerCtrl = enableTrigger; 
status = 1; 

} 

else 

status = 0; 
return status; 

} 



int 

enableSof tTrigger (void) 

/* Enables the use of a software trigger as opposed to a trigger from the 
** camera. See Sect 3.13 in AM Ref man. 

*/ ( 

const triggerCtrl = 0xfa000018; 

const enableTrigger = 0x0001; /*Trigger enabled */ 

const triggerSource = 0x0002; /* Trigger comes from software trig, 
register */ 

const triggerNotActive = 0x0004; / *read-only , 1 : No ext . trigger cycle in 
progress * / 

int status; 

if ( ( * (WORD* ) triggerCtrl & tr iggerNotAct ive ) ) { / * trigger not in 

progress */ 

* (WORD* ) triggerCtrl = (enableTrigger | triggerSource); 
status = 1; 

} 

else 

status = 0; 
return status; 



} 



void 
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sof tTrigger (void) 

/* Causes an external trigger pulse to the AM, if the software trigger is 
** enabled. See sect 3.15 in AM Ref Man. 

*/ ( 

const sof twareTrigger = OxfaOOOOlc; 
const goEnable = 0x0000; 

* (WORD* ) sof twareTrigger = goEnable; 

} 



FILENAME : imsSys tem . h 

DESCRIPTION: This file contains prototypes for the low 

level image routines that interface with 
the IMS and its modules 

REVISION HISTORY: jck: LT John Kisor USN Winter 95’ 

jck 950110 

★ *★**★*★**★★★**★****★******★***★***★***★*★★*★*★*★*★**★****** j 

I ★ * *No tes ****** 

940111 Have kelbe check code for style 

940112 Have to use constants instead of defines for clear/setMask masks 
940112 Find out how much of Sparc's memory is currently used. 

*★★★★★★★★★*★★★* j 



typedef enum { A0, 

Al, 

Bl, 

AM, 

DM 

} IMSPage; 



/* image frame A0 */ 

/* image frame Al */ 

/* image frame Bl */ 

/* acquis tion module */ 
/* display module */ 



typedef enum { CAMERA, /* Input will be the camera */ 

AOZERO, /* Input to A0 will be all zeros */ 
CONSTANT,/* input will be value set in constant mask */ 
AOONES , /* input to A0 will be all ones */ 

INA0 , /* input will be image in frame A0 */ 

INA1 , /* input will be image in frame Al */ 

INB1 /* input will be image in frame Bl */ 

} INPUTPath; 



typedef enum { GRAB, /* Continuously grab an image */ 

SNAP, /* Snap only one image */ 

FREEZE /* Stop grabbing images */ 

} ACQUIREType; 



void 
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cycleThroughLEDs (void) ; 

/* Visual positive reenforcement. Cycles through all the LEDS once 
*/ 

void 

setFirstKToCons tant ( IMSPage pageNumber , WORD filler); 

/* Puts a selected bit pattern in the first IK of a page so that 
** the difference between the pattern and image will be more noticable. 
*/ 



void 

initIMS (void) ; 

/* Initializes the IMS board to standard addressing w/IMB page size and 
** offset of 0x00 from the default address that is the beginning of 
** A24 space. (i.e. OxfaOOOOOO) Then it selects the acquistion register 
** using the page register 
*/ 



void 

clearMask ( IMSPage frameNum); 

/* Sets the mask to allow ALL bits to pass into the frame specified 
** See IMS Ref man 3.3 and setMask 
*/ 



void 

setMask ( IMSPage frameNum); 

/* Sets the mask to allow NO bits to pass into the frame specified 
** See IMS Ref man 3.3 and setMask 
*/ 

void 

setAOIControl (void) ; 

/* Sets the video bus out of AOI mode. 

** See sect 3.9.4 in IMS Ref man 
*/ 

void 

selectPage ( IMSPage pageNumber); 

/* Selects between the different image frames and modules on the IMS board 
*/ 

void 

setIMSControl (void) ; 

/* Sets the IMS control register. See section 3.11 of the IMS hardware Ref 
man 
*/ 
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void 

setFramelRQ ( void) ; 

/* The type of frame interrupt will be put here. 
** Currently not used. 

*/ 



void resetFrameCtrl ( IMSPage frameNum); 

/* Resets the controls for horizontal pitch, tiling and write zoom for 
** frames AO, A1 and Bl. See IMS Ref man 3.29, 3.34 
*/ 



void 

resetFramePanScroll ( IMSPage frameNum) ; 

/* Resets a frame for no (zero) pan and scroll. See 3.21 of the IMS ref man 

*/ 

void 

setXPortSwitch ( void) ; 

/ * Sets the cross-port switch for the application bus width and direction 
** This register must be set prior to setting any path registers 
** See AM Ref man sect 3.43 
*/ 

void 

setlnputPath ( IMSPage selectedFrame, INPUTPath imageSource) ; 

/* Selects the source of the image that will be put into a particular 
** frame. See AM Ref Man 3.40, 3.41 and 3.42 
*/ 

void 

setFrameAcquire ( IMSPage frameNum, ACQUIREType typeOf Acquire ) ; 

/* controls the acquistion to frame AO, Bl or Al 

** The input cross port switch should be set prior to calling this f unc . 
** Decision was made to have actual acquis tions triggered by the 
** acquisition enable register (3.19 Ref man) 

*/ 



void 

acqEnable ( void) ; 

/* This register controls the synchronous acquisition into the IMS 
** frame stores (see IMS ref man 3.19) This enables acquisition into the 
** frame stores when an acquire is pending in the IMS acquisition registers 
** and the frames waitAcq is set 
*/ 



/★★★★★★★★***★**★★**★★*********★**★★★★*★★***★**★***★*★★★*★★** 
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FILENAME: 

DESCRIPTION: 



imsControl . c 

This file contains the main image board control 
functions 

REVISION HISTORY: jck: LT John Kisor USN Winter 95' 

jck 950110 

**★★*★*★*★***★**★**★★**★**★*★★***★*★*★★★★★*★★★**★**★•*•***•*•*** j 

jck 950111 

To shorten the descriptions below several abbreviations are used: 
AM: Acquisition module 
DM: Display module 

AO : Frame AO 
Al : Frame Al 
B1 : Frame B1 

Acq: acquisition (as in waitAcq, waitAquisi tion) 

IMS Ref Man: Imaging Technology Inc's IMS (Standard Image Manager) 
reference Manual for series 150/40 

★ **★★*★****★***★***★*★•*•**★★* j 



#include "definitions . h" 
# include "system.h" 
#include "stdiosys .h" 



#include " displayCtrl .h" 
#include "acquisitionCtrl .h" 
#include " imsControl . h" 



void 

setFirs tKToConstant ( IMSPage pageNumber, WORD filler) 

/* Puts a selected bit pattern in the first IK of a page so that 
** the difference between the pattern and image will be more noticable. 
*/ { 

unsigned long frame = OxfaOOOOOO; 
int i, z; 

selectPage (pageNumber ) ; 

print f (" Filling memory with 0x%x\n" , filler ) ; 
printf ( "Filling line # " ) ; 

for (i=0; i<450; i++){ /*only stuff we see, 1024 will clear entire 
frame* / 

if (i < 10) 

printf ( " \b" ) ; 
else if (i < 100) 
printf ( " \b\b" ) ; 
else if (i < 1000) 
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printf ( " \b\b\b" ) ; 
else 

printf ( " \b\b\b\b" ) ; 
printf ( ” %d" , i ) ; 
for (z = 0; z<1024 ; z + +) { 

* (WORD* ) frame = filler; 
frame + = 2; 

} 

} 

printf ( " \n" ) ; 



void 

cycleThroughLEDs (void) 

/* Visual positive reenforcement. Cycles through all the LEDS once 
*/ ( 

int i , j ; 

resetAllLEDs ( ) ; 

LEDon (FIRST_LED) ; 

LEDof f ( LAST_LED) ; 

j = 0; 

for(i=0; i< 35000; i++) /* Emotional positive feedback for jck */ 

if ( (i % 5000) == 0) { 

changeLEDstate (FIRST_LED+j ) ; 
if (j == ( LAST_LED - 1)) { 

changeLEDstate (FIRST_LED) ; 
j = 0; 

} 

else { 

changeLEDstate ( FIRST_LED+j + 1); 

) 

} 

} 



void 

initIMS (void) 

/* Initializes the IMS board to standard addressing w/lMB page size and 
** offset of 0x00 from the default address that is the beginning of 
** A24 space. (i.e. OxfaOOOOOO) Then it selects the acquistion register 
** using the page register 
*/ { 

const imsConfigReg = 0xfc000600; 
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const s tandardAddressing = 0x04; 
const OneMegPage = 0x00; 

const baseAddressOf f set = 0x0000; 

* (WORD* ) imsConf igReg = ( s tandardAddressing | OneMegPage | 
baseAddressOf f set ) ; 

puts ( " Setting IMS for A24/D16 with base address of 0x000 (faOOOOOO)") 
initDisplay( Nl800by600 ) ; /* 800x600 non-interlaced */ 

initAcqModule ( ) ; 

puts ( "Acquisition module registers are set."); 

selectPage (A0) ; /* Select frame A0 */ 

clearMask (A0 ) ; 
clearMask (Al ) ; 
clearMask (Bl ) ; 

puts ("Masks cleared for: A0 # Al and Bl"); 

setAOIControl ( ) ; 

puts ( "Disabled AOI control . " ) ; 



setIMSControl ( ) ; 

puts (" Setting IMS control register"); 

resetFrameCtrl (A0) ; 
resetFrameCtrl (Bl) ; 

puts("Reset frame control registers for A0, Al and Bl"); 

resetFramePanScroll (A0) ; 
resetFramePanScroll (Al) ; 
resetFramePanScroll (Bl) ; 

puts ("Set zero pan and scroll for frames A0, Al and Bl"); 
setXPortSwitch ( ) ; 

puts ( "Cross-port switch is set"); 



} 



void 

clearMask ( IMSPage frameNum) 

/* Sets the mask to allow ALL bits to pass into the frame specified 
** See IMS Ref man 3.3 and setMask 
*/ { 

const frameAMask = 0xfc000608; 



115 



const frameBMask 



Oxf c00060c ; 



const frameAOMask 
const frameAlMask 
const frameBIMask 



Oxf fOO 
0x00 f f 
Oxf f f f 



/*This sets constant mask to 0x00 also */ 



WORD oldFrameAMask = * (WORD* ) f rameAMask; 



printf ( "Clearing mask for frame: "); 

switch ( f rameNum) { 

case A0: * (WORD* ) f rameAMask = (oldFrameAMask | frameAOMask); 

puts ( "A0 " ) ; 
break ; 

case Al : * (WORD* ) f rameAMask = (oldFrameAMask | frameAlMask) ; 

puts ( " Al " ) ; 
break ; 

case Bl: * (WORD* ) frameBMask = (frameBIMask ); 

puts( "Bl" ) ; 
break; 

default : 

puts (" Error : clearMask - Illegal frame selected"); 
rexit ( ) ; 

} 

} 



void 

setMask ( IMSPage f rameNum) 

/* Sets the mask to allow NO bits to pass into the frame specified 
** See IMS Ref man 3.3 and setMask 
*/ { 

const f rameAMask = 0xfc000608; 

const frameBMask = 0xfc00060c; 



const frameAOMask 
const frameAlMask 
const frameBIMask 



Oxf f 00 
OxOOff 
Oxf f 00 



/*This sets constant mask to Oxf also */ 



WORD oldFrameAMask = * (WORD* ) f rameAMask ; 



print f (" Protect ing with mask frame: "); 

switch ( f rameNum) { 

case A0: * (WORD* ) f rameAMask = (oldFrameAMask Sc frameAOMask); 

puts ( "A0 " ) ; 
break; 

case Al: * (WORD* ) f rameAMask = (oldFrameAMask & frameAlMask); 

puts ( " Al " ) ; 
break; 

case Bl: * (WORD* ) frameBMask = (frameBIMask ); 
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puts ( " B1 " ) ; 
break; 



default : 

puts (" Error : setMask - Illegal frame selected"); 
rexit ( ) ; 

} 

} 



void 

setAOIControl (void) 

/* Sets the video bus out of AOI mode. 
** See sect 3.9.4 in IMS Ref man 
*/ ( 

const AOIControl = 0xfc000617; 
const disableAOI = 0x00; 

* (BYTE* ) AOIControl = disableAOI; 

} 



void 

selectPage ( IMSPage pageNumber) 

/* Selects between the different image frames and modules on the IMS board 
*/ { 



const imsPageReg 



Oxf c000620 ; 



const selectFrameAO 
const selectFrameAl 
const selectFrameBl 
const selectAM 
const selectDM 



0x0010; 

0x0011; 

0x0013; 

0x0014; 

0x0015; 



switch 

case 



case 



case 



case 



case 



(pageNumber) { 

A0: * (WORD* ) imsPageReg = selectFrameAO; 

puts (" Selecting Frame A0"); 
break; 

A1 : * (WORD* ) imsPageReg = selectFrameAl; 

puts (" Selecting Frame Al"); 
break; 

Bl: * (WORD* ) imsPageReg = selectFrameBl; 

puts (" Selecting Frame Bl"); 
break; 

AM: * (WORD* ) imsPageReg = selectAM; 

puts (" Selecting Acquisition module\n" ) ; 
break; 

DM: * (WORD* ) imsPageReg = selectDM; 

puts (" Selecting Display module\n" ) ; 
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break; 



} 



} 



void 

setIMSControl (void) 

/* Sets the IMS control register. See section 3.11 of the IMS hardware Ref 
man 
*/ { 

const imsControl = 0xfc000624; 

const FPSel = 0x0000; /* Sets the IMS to be master. */ 

const clockspeed = 0x0004; /*Se ts clock speed to be 20Mhz */ 

const DispMode = OxOOaO; /*DISPOE, ETMODE, DMEN, CBMR */ 

/* DISPOE ( 1 ) : Enable display output. Not needed since DM is present 

*/ 

/* ETMODE ( 0 ) : Define AM module trigger mode. */ 

/* DMEN (1): Enable image display */ 

/* CBMR (0): Do not clear the mask registers. This bit can be 
used to protect all frame bits */ 

* (WORD* ) imsControl = (FPSel (clockspeed | DispMode ); 
puts ("IMS set 20Mhz, IMSrmaster, Display : enabled and in AM trigger 
mode\n" ) ; 

} 



void 

setFramelRQ (void) 

/* The type of frame interrupt will be put here. 
** Currently not used. 

*/ { 

/*Empty function */ 

} 



void resetFrameCtrl ( IMSPage frameNum) 

/* Resets the controls for horizontal pitch, tiling and write zoom for 
** frames A0, A1 and Bl . See IMS Ref man 3.29, 3.34 
*/ { 

const f rameACtrl = 0xfc000650; /* Frame A0 and Al control */ 
const frameBCtrl = 0xfc00065a; /* Frame Bl control */ 

/* Write (output) zoom */ 

const aUnPack = 0x0000; /* 0; normal ops, no packing of bits in 

A0 , Al */ 

const verticalZoom = 0x0000; / * No zoom, but a good project for someone. 
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*/ 

const horizontalZoom = 0x0000; 

/* Read (input) zoom) */ 

const bNoHorizZoom = 0x0000; /* No zoom. Avail: lx, 2x and 4x */ 

const bNoVertZoom = 0x0000; 

/* Write (output) zoom */ 

const bUnPack = 0x0000; /* 0: normal ops, no packing of bits in B1 */ 

const bWriteVertZoom = 0x0000; 
const bWriteHorizZoom = 0x0000; 

print f ( "Resetting frame: " ) ; 

switch (frameNum) { 
case A0 : 

case Al : * (WORD* ) f rameACtrl = (aUnPack | verticalZoom | 
horizontalZoom) ; 

puts(" A0 and Al " ) ; 
break; 

case B1 : * (WORD* ) f rameBCtr 1 = (aUnPack | bUnPack | 

bNoVertZoom | bNoHorizZoom | 
bWriteVertZoom | bWriteHorizZoom ) ; 

puts ( " B1 " ) ; 
break; 

default : 

puts ( "Error : resetFramePanScrolACtrl - Illegal frame selected\n" ) ; 
rexit ( ) ; 

} 

} 



void 

resetFramePanScroll (IMSPage frameNum) 

/* Resets a frame for no (zero) pan and scroll. See 3.21 of the IMS ref man 



*/ { 








const 


aOReadPan 


— 


Oxf c000640 


const 


aOReadScroll 


= 


Oxf c000642 


const 


aOWritePan 


= 


Oxf c000644 


const 


aOWriteScroll 


= 


Oxf c000646 


const 


alReadPan 


= 


Oxf c000648 


const 


alReadScroll 


- 


0xfc00064a 


const 


alWritePan 


= 


Oxf c00064c 


const 


alWriteScroll 


= 


Oxf c00064e 


const 


blReadPan 


= 


0xfc000652 


const 


blReadScroll 


= 


Oxf c000654 


const 


blWritePan 


= 


Oxf c0006 5 6 


const 


blWriteScroll 


= 


Oxf c000658 
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const zeroPan 
const zeroScroll 



0x00; 

0x00; 



print f (" Setting pan and scroll to 
switch (frameNum) { 

case A0: * ( WORD* ) aOReadPan 

* (WORD* ) aOReadScroll 
* (WORD* ) aOWritePan 
* (WORD* ) aOWriteScroll 
puts ( " AO. " ) ; 
break; 



zero for frame: 

= zeroPan; 

= zeroScroll; 

= zeroPan; 

= zeroScroll; 



") ; 



case Al : * ( WORD* ) alReadPan 

* (WORD* ) alReadScroll 
* (WORD* ) alWritePan 
* (WORD* ) alWriteScroll 
puts ( " Al . " ) ; 
break; 

case B1 : * (WORD* ) blReadPan 

* (WORD* ) blReadScroll 
* (WORD* ) blWritePan 
* (WORD* ) blWriteScroll 
puts ( " B1 . ") ; 
break; 



zeroPan ; 
zeroScroll; 
zeroPan; 
zeroScroll ; 



zeroPan; 
zeroScroll ; 
zeroPan ; 
zeroScroll ; 



default : 

puts ( " Error : resetFramePanScroll - Illegal 
rexit ( ) ; 



frame 



} 



selected" ) ; 



} 



void 

setXPortSwitch ( void) 

/* Sets the cross-port switch for the application bus width and direction 
** This register must be set prior to setting any path registers 
** See AM Ref man sect 3.43 
*/ { 

unsigned int crossPortSwitch = 0xfc000670; 
const portConstant = 0x0007; 
int i ; 

for (i=0; i<8; i++){ /* Go through 8 words, 0x70->0x7f */ 

* (WORD* ) crossPortSwitch = portConstant; 
crossPortSwitch += 0x00000002; 

} 

} 
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void 

setlnputPath ( IMSPage selectedFrame, INPUTPath imageSource) 

/* Selects the source of the image that will be put into a particular 
** frame. See AM Ref Man 3.40, 3.41 and 3.42 



*/ { 








const 


aOlnputPath 


= 


Oxf c00066a ; 


const 


allnputPath 


= 


Oxf c00066c; 


const 


bllnputPath 


= 


Oxf c00066e; 


const 


cameralnput 


= 


0x00b8 ; 


const 


aOZeroInput 


= 


0x0 OcO ; 


const 


constantlnput 


= 0x0090; 


const 


aOOnesInput 


= 


OxOOeO ; 


const 


aOlnput 


= 


0x0288 ; 


const 


allnput 


= 


0x0298; 


const 


bllnput 


= 


0x02b0 ; 



switch (selectedFrame) { 
case AO : 

switch ( imageSource) { 

case CAMERA: * ( WORD* ) aOlnputPath = cameralnput; 
break; 

case AOZERO: * ( WORD* ) aOlnputPath = aOZeroInput; 

break; 

case CONSTANT: * (WORD* ) aOlnputPath = constantlnput; 
break; 

case AOONES: * (WORD* ) aOlnputPath = aOOnesInput; 
break; 

case INAO : * (WORD* ) aOlnputPath = aOlnput; 

break; 

case INA1 : * (WORD* ) aOlnputPath = allnput; 

break; 

case INBl : * (WORD* ) aOlnputPath = bllnput; 

break; 

default : 

puts (" Error : setlnputPath - Illegal input for frame AO selected.") 
rexit ( ) ; 

} 

break; 
case A1 : 

switch ( imageSource) { 

case CAMERA: * ( WORD* ) allnputPath = cameralnput; 

break; 

case CONSTANT: * (WORD* ) allnputPath = constantlnput; 

break; 

case INAO: * (WORD* ) allnputPath = aOlnput; 
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break; 

case INA1: * { WORD* ) allnputPath = allnput; 

break; 

case INB1 : * (WORD* ) allnputPath = bllnput; 

break; 

default : 

puts ( "Error : setlnputPath - Illegal input for frame Al selected.”) 
rexi t ( ) ; 

} 

break; 



case B1 : 

switch { imageSource) { 

case CAMERA: * (WORD* ) bllnputPath 

break; 

case CONSTANT : * (WORD* ) bllnputPath 

break; 

case INAO: * (WORD* ) bllnputPath 

break; 

case INAl : * (WORD* ) bllnputPath 

break; 

case INB1: * (WORD* ) bllnputPath 

break; 



cameralnput ; 
constantlnput ; 
aOInput ; 
allnput ; 
bllnput ; 



default : 

puts ( "Error : setlnputPath - Illegal input for frame B1 selected.") 
rexit ( ) ; 



} 

break; 



default : 

puts ( " Error : setlnputPath - Illegal destination frame selected.") 
rexit ( ) ; 



} 



} 



void 

setFrameAcquire ( IMSPage frameNum, ACQUIREType typeOf Acquire ) 

/* controls the acquistion to frame AO, B1 or Al 

** The input cross port switch should be set prior to calling this func 
** Decision was made to have actual acquistions triggered by the 
** acquisition enable register (3.19 Ref man) 

*/ ( 

const frameAOAcq = 0xfc000630; 
const frameAlAcq = 0xfc000632; 
const frameBlAcq = 0xfc000636; 

const triggerMode = 0x00; /* No wait for trigger from AM */ 
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const waitAcq = 0x02; /* prevent acquisition till acqEnable is written 
*/ 

WORD acquireMode; 

swi tch ( typeOf Acquire) { 
case SNAP: 

acquireMode = 0x0080; /*Make this a snap operation {one picture) */ 
break; 
case GRAB: 

acquireMode = OxOOcO; /*Make this a grab operation {continuous 

snap) * / 

break; 

case FREEZE: 

acquireMode = 0x0000; /* Stop taking pictures */ 
break; 
default : 

puts ( " Error : setFrameAcquire - Illegal type of acquire selected. "); 
puts (" Stopping grab or snap, if enabled\n" ) ; 
acquireMode = 0x0000; 
break; 

} 

pr intf (" Setting Acquistion controls for "); 
switch (frameNum) { 

case A0: while { { * {WORD* ) f rameAOAcq & 0x0010)) 

* (WORD* ) f rameAOAcq = (triggerMode | waitAcq [acquireMode ); 
puts { "Frame A0 " ) ; 
break; 

case A1 : while ( { * {WORD* ) f rameAlAcq & 0x0010)) 

* (WORD* ) f rameAlAcq = (triggerMode | waitAcq [acquireMode ); 
puts {"Frame A1 "); 
break; 

case B1 : while ( { * {WORD* ) f rameBlAcq & 0x0010)) 

* {WORD* ) f rameBlAcq = (triggerMode | waitAcq | acquireMode ); 
puts {"Frame B1 "); 
break ; 

default : 

puts ( " Error : setFrameAcq - Illegal frame selected."); 
rexit ( ) ; 

} 

puts {" awaiting AM trigger and acquistion enable\n" ) ; 

} 



void 

acqEnable (void) 

/* This register controls the synchronous acquisition into the IMS 
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** frame stores (see IMS ref man 3.19) This enables acquisition into the 
** frame stores when an acquire is pending in the IMS acquisition registers 
** and the frames waitAcq is set 
** For system reset use: IV-SPRC > ex fffc00e3 
** 0xfffc00e3: Oxff ? fO 

*/ { 

const f rameAcqEnable = 0xfc000634; 

const enable = 0x0000; 

* (WORD* ) f rameAcqEnable = enable; 

puts ("IMS enabled for image acquistion . \n" ) ; 



} 

j -k A ★ ★ *★★★★★■*★★ •>*****-A^ **★★★*★★★★★★★★*★★*★★★★******★★★★*★★*★★★*★*★■*★★ j 

/* F .lLENAME : image log . h 

/* AUTHOR: Leonard V. Remias and Khaled Morsy 
/* some fragments from Kelbe 

/* DATE: OlMarch 1996 

#ifndef IMAGELOG_H 

#def ine IMAGELOG_H 

/* 

Must be called prior to turning on image logging. This makes 
image logging two steps. This must be, since we cannot depend 
on static variables being properly initialized on Yamabico 
for subsequent runs . 

*/ 

void Init Imagelog ( void) ; 



Function prepares the tracing system to log data. 

The tracing frequency specifies how many image control cycles are 
skipped before a data point is logged. A value of 1 or less causes 
the logging to occur each cycle. 

The filename is the name of the file to create on the host. If NULL 
is passed in, a default name is used. 

The buffer size specifies how many bytes of storage to allocate to 
save the data. If a value of 0 is specified, a default size is used. 

Tracing is automatically turned on after this call. 

The simplest way to call this function and have image logging is: 

InitlmageLog (NULL, 0) ; 

This will use all of the default values, and should work fine for most 
cases . 
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*/ 

void ImageLog (char ^Filename, int BufferSize) ; 

/* 

Function enables data logging. Frequency is used by the 
system’s logging functions to determine the number of image 
control cycles between logged data. For example, if the 
frequency is 3, then data would be logged on every third call 
to LogTimedlmage ( ) or LoglmageData ( ) . Use this to change 
the logging frequency. 

*/ 



/★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★•a-*** j 

/* FILENAME : imagelog . c 

/* AUTHOR: Leonard V. Remias and Khaled Morsy 
/* some fragments from Kelbe 

/* DATE: OlMarch 1996 

/* PURPOSE: Prepare the system for image logging 
*/ 

#include "definitions . h" 

#include " imagelog. h" 

#include "stdiosys.h" 

#include " trace. h" 



/*** Local variables ***/ 

static IOhandle LogHandle; 

static int Enabled; 



/*** Code ***/ 



void 

Initlmagelog (void) 

{ 

LogHandle = EOF; 
Enabled = 0; 



} 



void 

ImageLog (char * filename, int bufSize) 

{ 

if (bufSize <= 0) 

bufSize = IMAGELOGSIZE ; /* if not specified, use the default */ 

if (filename == NULL) 
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filename = IMAGELOGFILE ; 



LogHandle = IOopenimage ( filename , bufSize) ; 
if (LogHandle == EOF) { 

printf ( " \nError initializing image logging file %s\n" ( filename); 
return; 

} 

Enabled = 1; 



void 

Loglmage ( YAMAIMAGE bl image) 



int i , j ; 

/* checking LogHandle here is not really necessary, but saves a function 
call */ 

if (Enabled) 



for ( i=0 ; i<476; i++) 

{ 

f or ( j = 0 ; j<732; j++) 

{ 

IOprint f (LogHandle, "%d\n" , blimage. image [i] [ j ] ) ; 

} 

} 
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